-- Logs begin at Tue 2022-09-13 06:20:50 UTC, end at Tue 2022-09-13 07:15:18 UTC. -- Sep 13 06:45:45.692625 dv-cinder-856941-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 06:45:45.699657 dv-cinder-856941-4-smb devstack@keystone.service[81397]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 06:45:45 2022] *** Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: nodename: dv-cinder-856941-4-smb Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: machine: x86_64 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: clock source: unix Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: pcre jit disabled Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: detected number of CPU cores: 4 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: current working directory: / Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: detected binary path: /usr/bin/uwsgi-core Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: your processes number limit is 47680 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: your memory page size is 4096 bytes Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: detected max file descriptor number: 2048 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: lock engine: pthread robust mutexes Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: thunder lock: enabled Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 06:45:45.704674 dv-cinder-856941-4-smb devstack@keystone.service[81397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 06:45:45.743324 dv-cinder-856941-4-smb devstack@keystone.service[81397]: Python main interpreter initialized at 0x564c6f1d39c0 Sep 13 06:45:45.743324 dv-cinder-856941-4-smb devstack@keystone.service[81397]: python threads support enabled Sep 13 06:45:45.743324 dv-cinder-856941-4-smb devstack@keystone.service[81397]: your server socket listen backlog is limited to 100 connections Sep 13 06:45:45.743324 dv-cinder-856941-4-smb devstack@keystone.service[81397]: your mercy for graceful operations on workers is 90 seconds Sep 13 06:45:45.743729 dv-cinder-856941-4-smb devstack@keystone.service[81397]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 06:45:45.743813 dv-cinder-856941-4-smb devstack@keystone.service[81397]: *** Operational MODE: preforking *** Sep 13 06:45:45.744032 dv-cinder-856941-4-smb devstack@keystone.service[81397]: *** uWSGI is running in multiple interpreter mode *** Sep 13 06:45:45.744032 dv-cinder-856941-4-smb devstack@keystone.service[81397]: spawned uWSGI master process (pid: 81397) Sep 13 06:45:45.744239 dv-cinder-856941-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 06:45:45.746206 dv-cinder-856941-4-smb devstack@keystone.service[81397]: spawned uWSGI worker 1 (pid: 81411, cores: 1) Sep 13 06:45:45.747666 dv-cinder-856941-4-smb devstack@keystone.service[81397]: spawned uWSGI worker 2 (pid: 81412, cores: 1) Sep 13 06:45:45.747666 dv-cinder-856941-4-smb devstack@keystone.service[81397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 06:45:50.156672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:45:50.156672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: from cryptography.utils import int_from_bytes Sep 13 06:45:50.157474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:45:50.157474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: from cryptography.utils import int_from_bytes Sep 13 06:45:50.171921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:45:50.171921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: from cryptography.utils import int_from_bytes Sep 13 06:45:50.172511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:45:50.172511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: from cryptography.utils import int_from_bytes Sep 13 06:45:50.209766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:45:50.209970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:45:50.210140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] command line args: [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:45:50.210410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:45:50.210589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ================================================================================ {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:45:50.210845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] admin_token = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.211093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] config_dir = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.211281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.211465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] config_source = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.211647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] debug = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.211847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.212358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.212451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.212687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.212940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.213172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.213351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_config_append = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.213530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.213706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_dir = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.213878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_file = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.214107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.214370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.214599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.214846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.215041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.215190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.215435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.215683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.215919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.216153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.216387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.216639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.216890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.217137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.217413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.217927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.218119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] publish_errors = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.218334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.218580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.218743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.218991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.219230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.219465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] standard_threads = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.219697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.219943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.220119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.220295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] use_journal = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.220471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] use_json = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.220674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] use_stderr = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.220852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] use_syslog = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.221085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.221342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.221580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.221840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.222078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.222333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.223102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.223350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.223582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.223829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.224074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.224324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.224556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.224826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.225065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.225316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.225563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.225800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.226056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.226311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.226598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.227964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.227964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.227964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.227964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.227964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.228315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.228421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.228696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.228829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:45:50.228937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.229029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:45:50.229160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.229248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] command line args: [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:45:50.229413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.229496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:45:50.229634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ================================================================================ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:45:50.229755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.229869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.229980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] admin_token = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.230105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.230219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_dir = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.230338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.230457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.230576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_source = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.230691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.230856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] debug = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.230972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.231090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.231230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.231343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.231343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.231570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.231570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.231788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.231902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.232013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.232137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.232250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.232369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.232509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.232656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_config_append = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.232790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.232910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.233032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_dir = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.233152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.233265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.233376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.233496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.233615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.233728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.233840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.233958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.234071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.234192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.234309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.234427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.234541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.234745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.234843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.234945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.235058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.236245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.236245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.236500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.236635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.236767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.236890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.237013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.237134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.237248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.237362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.237552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.237668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.237787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.237906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.238022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.238022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.239143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.239263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.239390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] publish_errors = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.239512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.239635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.239755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.239870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.239870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.240088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.240202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.240324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.240429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.240525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.240662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] standard_threads = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.240765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.240859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.240976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_journal = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_json = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_stderr = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_syslog = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.241452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.242793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.243037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.243274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.243523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.243760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.244008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.244258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.244496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.244778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.245035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.245283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.245521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.245776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.245892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.246863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.247946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.248933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.249838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.250934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.251849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.252887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.253756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.254748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.255894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.external = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.256938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.password = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.257990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.258103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] auth.token = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.258215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.258349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.259525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.259658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.259782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.259907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.260898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.261935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.262975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.263959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.264866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.265941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.266933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.external = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.267946 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.268882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.password = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.269006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.269006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.269220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.token = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.269422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.270843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.271882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.272796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.273906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.274898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.275863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.276950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.277970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.278202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.278325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.278551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.278757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.278878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.279987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.280921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.281999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.282924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.283927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.284848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.285498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.286085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.286209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.286310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.286407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.286512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.287512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.287651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.287651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.287835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.287932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.288985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.289924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.290979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291573 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.291930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.292968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.293917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] role.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] role.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.294941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.295892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.296910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.297964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.298889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.299890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.300655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.301898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.301898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.302885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.303952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.304913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.305958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.306926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.connection = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.307998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.308970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.309982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.310107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.311730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:45:50.313023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.313915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.314148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.314399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.314659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.314909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.315148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.315385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.315617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.315856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.316095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.316773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.316773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.316995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.317140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.317380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.317627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.317873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.318122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.318359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.318598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.318833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.319081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.319360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.319592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.319837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.320106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.320367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.320631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.320885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.321124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.321367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.321603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.321841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.322077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.322314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.322559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.322796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.323040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.323280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.323529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.323763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.324176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.324416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.324690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.324929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:45:50.325102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:45:50.346273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.346517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.346722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.356272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.357958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.358555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.358555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.367509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.386765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.386996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.387132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.387369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.447252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.449373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.498652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.498886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.499233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.499474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.658459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.658625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.658823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.659839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.660536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.660926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.683775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.684980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.685111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.685239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.685368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.685497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.685634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.697202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.697858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.710683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.710924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.711981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.712114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.712240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.712365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.712365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81411) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:45:50.728789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.729001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:45:50.729241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.729383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.729518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:45:50.729666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:45:50.729810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.729938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:45:50.730191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.730956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.740305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.740600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.740847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.740975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.741137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.741276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.741409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.741686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.748131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.748700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.751072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.751360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.751614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.751741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.751906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.752842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.753027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.753107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.753301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.753380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.753575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.754152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.754398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.754486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.754820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.755106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.777833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.778480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.779301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.779587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.779953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.780242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.784293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.784598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.784896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.785120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.785410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.785697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.791330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.791618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.792030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.792319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.797466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.797770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.798356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.798893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.799998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.815319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.815602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.815743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.816003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.820163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.820413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.823441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.823684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.823766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.823985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.827975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.828163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.831241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.831332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.835229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.835339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.835529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.835612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.835858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.835941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.836919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.852535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.852648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.852851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.852932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.853123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.853214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.853391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.853471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.860234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.860321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.861812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.861949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.863374 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.863487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.863694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.863783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.866432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.866580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.866721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.866869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.867842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.879832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.880219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.880399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.880508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.880721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.880818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.881950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.882243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.897852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.898550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.900803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.901501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.903688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.904430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.905177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.905933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.906645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.906939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.907346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.907427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.907678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.908075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.914031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.914628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.915457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.916096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.918391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.918795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.919966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.927709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.928012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.928107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.928300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.928382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.928668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.935235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.935527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.935608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81411) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:45:50.935811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.935891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.936955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.937857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.938940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.939137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81411) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:45:50.974465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c6f1d39c0 pid: 81412 (default app) Sep 13 06:45:50.974908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c6f1d39c0 pid: 81411 (default app) Sep 13 06:45:50.977987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67adf6-62c7-4152-b8cd-500d084a45c5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:50.978277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67adf6-62c7-4152-b8cd-500d084a45c5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:50.978549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67adf6-62c7-4152-b8cd-500d084a45c5 None None] PATH_INFO: `/v3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:50.982703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Sep 13 06:45:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:57.771482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:57.772002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:57.772002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:57.776276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:45:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:45:57.781461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:57.781867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:57.782003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:57.852911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: INFO dbcounter [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] Registered counter for database keystone Sep 13 06:45:57.871459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG oslo_db.sqlalchemy.engines [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:45:57.877562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writer thread running {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:45:58.057326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG passlib.handlers.bcrypt [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 06:45:58.057713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG passlib.handlers.bcrypt [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 06:45:58.115251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:58.116848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:58.243975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:45:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 06:45:58.694080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:58.763253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: INFO dbcounter [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] Registered counter for database keystone Sep 13 06:45:58.784627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG oslo_db.sqlalchemy.engines [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:45:58.791453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writer thread running {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:45:58.909613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ed89f-b8a0-4a23-8710-6faac05b02ab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:58.914037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:58.914672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:58.914954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:58.915226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:58.923294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:58.975171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 06:45:58.975451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87564a-9d92-49f3-820c-ffdbad8c72bc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:58.984655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 13 06:45:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:58.990703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:59.007482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd217dd-1ad8-4aed-90f0-3d80802ef07d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:59.011837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:59.012994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:59.013277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:59.013556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] PATH_INFO: `/v3/projects/7293e66323e0459699b8f04045409629` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:59.015137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] RBAC: Authorizing `identity:get_project(project_id=7293e66323e0459699b8f04045409629)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:59.068137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 06:45:59.068473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75b2b-435f-4766-8bbd-1e598636e75d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:59.072962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Sep 13 06:45:58 2022] GET /identity/v3/projects/7293e66323e0459699b8f04045409629 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:01.191626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4cf88-ac9b-4a0d-9e58-6ea1ed709cab None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:01.192123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4cf88-ac9b-4a0d-9e58-6ea1ed709cab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:01.192333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4cf88-ac9b-4a0d-9e58-6ea1ed709cab None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:01.196402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:01.201747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:01.202141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:01.202303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:01.222590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:01.224199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:01.232039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 06:46:01.498973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4cf88-ac9b-4a0d-9e58-6ea1ed709cab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:01.512309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4cf88-ac9b-4a0d-9e58-6ea1ed709cab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:01.519879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:01.520897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:01.521210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:01.521547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:01.529357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:01.531117 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49f3e-f9ae-45fd-a650-3c15338b6288 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:01.539866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 13 06:46:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:46:01.545810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:01.555850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc671b5d-ab5d-474f-a322-02143235a8a2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:01.562184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:01.563247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:01.563745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:01.564248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:01.567192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:01.569595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2cb0-f184-4671-b4f3-c8d0ecca4a1e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:01.571130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Sep 13 06:46:01 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:03.772754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60c35-cc77-43ce-9e53-d163108fb8e2 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:03.773321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60c35-cc77-43ce-9e53-d163108fb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:03.773321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a60c35-cc77-43ce-9e53-d163108fb8e2 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:03.774606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:03.779781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:03.780174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:03.780324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:03.799220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:03.800987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:03.822825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f8a0-90e0-4c6a-9008-13d1fd3bd5be None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:03.823107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f8a0-90e0-4c6a-9008-13d1fd3bd5be None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:03.823380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148f8a0-90e0-4c6a-9008-13d1fd3bd5be None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:03.824820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:46:03.829927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:03.830172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:03.830441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:03.872403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG passlib.handlers.bcrypt [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81411) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 06:46:03.872827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG passlib.handlers.bcrypt [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81411) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 06:46:03.882067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:03.922141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:03.923706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:04.023096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:04.151472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.179588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.266299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b89fc-2de7-4f8a-af50-e0ee739e1954 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.297194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.299901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.300898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.301006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.301223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.312725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:04.322232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:04.323362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:04.324405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:04.328997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.400895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80673a-ad5f-4000-8f2d-690c2997f08b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.403173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.408982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.428297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171260a-4c27-43b0-adbd-8bf660a19dd1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.439553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.440424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.440752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.441549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.462710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.463306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.463577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.463842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.464496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:04.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.466198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.477624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:04.483237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.508801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.510326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.582447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dfc55-d14c-4c69-95f4-2ee9c1659f9e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.609092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:04.615287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.615826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.616456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.616761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.617035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.617965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.618148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.619603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.621305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:04.626402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.642893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.714688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73168-e8c4-4be1-b830-c32e1f4fa6da None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.728389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410609b3-a6e3-448e-841c-bf01086a8924 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.747824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.748773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.749048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.749318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.760974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.762082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.762360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.762633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.763754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.765738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.767302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.767402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:04.768942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.773600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:46:04.788230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:04.789489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:46:04.790311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:46:04.790311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:46:04.790311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:04.790311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:04.795051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:04.850842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.854210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:04.874494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00682f9e-dc91-4813-8171-db1a4825498c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.895456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627a99b-9522-449c-9269-9134c9649d8f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:04.908137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.908794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.909076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.909345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.911198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.domain.id=default, user.id=1083a60a7d7244f7a16714f47f1d6e8f) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:04.911506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.912968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b98f-2ab8-4771-8bce-7e98aa0412f8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.919658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/role_assignments?user.id=1083a60a7d7244f7a16714f47f1d6e8f&scope.domain.id=default&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:04.929172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:04.929804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:04.930082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:04.930353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:04.931021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:04.931320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:04.932775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dcd15-82ac-408e-b3d0-f5b8f2baed36 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:04.952779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:07.341510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadefc62-ef8f-442c-971a-0f5f55fac055 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:07.342376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadefc62-ef8f-442c-971a-0f5f55fac055 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:07.342818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadefc62-ef8f-442c-971a-0f5f55fac055 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:07.344321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:07.350703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309db3c-c02c-4434-88a8-19f9011c0ef7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:07.351544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309db3c-c02c-4434-88a8-19f9011c0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:07.351996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309db3c-c02c-4434-88a8-19f9011c0ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:07.385672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9309db3c-c02c-4434-88a8-19f9011c0ef7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:07.387201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9309db3c-c02c-4434-88a8-19f9011c0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:07.471102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:07.819609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadefc62-ef8f-442c-971a-0f5f55fac055 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:07.958912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadefc62-ef8f-442c-971a-0f5f55fac055 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:08.008622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:08.009615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.010086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.010524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.023778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c2178bd9-6231-41b3-a7b7-5f5605c59a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:08.030063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:08.030909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:08.031673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:08.032235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6338a-d979-47de-a19e-70dd30bb531b None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.032235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6338a-d979-47de-a19e-70dd30bb531b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.032235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6338a-d979-47de-a19e-70dd30bb531b None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.032235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:46:08.033793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:08.040521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6338a-d979-47de-a19e-70dd30bb531b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:08.043669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb13c3d-7a24-43d8-9f74-e2e3a5059c35 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.044175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb13c3d-7a24-43d8-9f74-e2e3a5059c35 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.044613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb13c3d-7a24-43d8-9f74-e2e3a5059c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.060346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:08.081810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6fb13c3d-7a24-43d8-9f74-e2e3a5059c35 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:08.082922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6fb13c3d-7a24-43d8-9f74-e2e3a5059c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:08.115102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:08.171990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6338a-d979-47de-a19e-70dd30bb531b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:08.195284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:08.196758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c986aa-a4ae-4574-9db4-99c85e8d2751 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.197146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c986aa-a4ae-4574-9db4-99c85e8d2751 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.197520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c986aa-a4ae-4574-9db4-99c85e8d2751 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.199692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 15/27] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:08.204452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9001d-e6ac-48fe-838e-98817530478c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.204452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9001d-e6ac-48fe-838e-98817530478c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.204452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9001d-e6ac-48fe-838e-98817530478c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.204452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 16/28] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:08.209590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.209882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.210160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.221070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:08.222529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.223348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.223811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.224734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:08.225248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:08.227960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ee391-601a-4529-bb74-b7832f6a2b18 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:08.240553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:08.247080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:08.254473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 13/29] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:08.260790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.261336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.261829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.293713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:08.295351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:08.385768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 17/30] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:08.387974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:08.423102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 14/31] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:08.484853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:08.486425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:08.519702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997041-713b-4f45-bc31-b97d2c649fae None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:08.576635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:08.580490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:08.581931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.582448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.582916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.587349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:08.589303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:08.591089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 18/32] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:08 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:08.596434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:08.674515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09828-da75-4757-abba-da9fe45a2d8a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:08.749976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:08.750616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.750899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.751172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.751863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:08.753834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:08.761376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65c04-a940-4625-987b-d6d6ffc228ed None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:08.816603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:08.825823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:08.826755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:08.827260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:08.827732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:08.829966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:08.831673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:08.833495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 19/33] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:08.834477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:08.916691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 15/34] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 06:46:08 2022] POST /identity/v3/roles => generated 225 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:08.916691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:09.041569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716dfa-76c9-4b29-a8d6-c14e5e5ddeb5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:09.089025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:09.089695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.089973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.090291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.114047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:09.114264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:09.115729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:09.119266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e219c13-c482-410e-83cb-15e94c968561 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:46:09.153264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:09.154203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:46:09.155004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:46:09.155004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:46:09.155004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:09.164154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 20/35] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:09.164858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:09.184373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:09.185557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.186058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.186606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] PATH_INFO: `/v3/domains/default/users/1083a60a7d7244f7a16714f47f1d6e8f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.190303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1083a60a7d7244f7a16714f47f1d6e8f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:09.193260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:09.214728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 16/36] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Sep 13 06:46:08 2022] PUT /identity/v3/domains/default/users/1083a60a7d7244f7a16714f47f1d6e8f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:09.215435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:09.241123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:09.322845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca37ae-03b8-4820-8ecb-a7f3b8aa6774 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:09.380982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:09.381630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.381964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.382242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.383583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:09.385674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369616a-09fa-4f3b-83e0-3b33cd2cfeda None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:09.389775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586f5c-ee2f-4874-8232-9e62cb45e47e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:09.430068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:09.431455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.431941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.432410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.433387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:09.433937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:09.435526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdadfb2-6a11-450a-b42d-b9021f4888e4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:09.449891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 17/37] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:09.451551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bce0-e2cc-417e-b788-240d9943d6d1 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.452050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bce0-e2cc-417e-b788-240d9943d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.452668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bce0-e2cc-417e-b788-240d9943d6d1 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.454103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:09.455414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1401-5710-48ce-8934-7d8a37433302 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.455911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1401-5710-48ce-8934-7d8a37433302 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.456351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1401-5710-48ce-8934-7d8a37433302 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.458499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:09.462732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb1401-5710-48ce-8934-7d8a37433302 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:09.484295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:09.518618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 06:46:09 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:09.520918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.521112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.521395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.544231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:09.545963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:09.583984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb1401-5710-48ce-8934-7d8a37433302 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:09.625572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:09.626641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.627130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.627616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.629085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:09.630903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133d9b8-6802-4284-b4bf-de19ec2487c4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:09.669606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:46:09 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:09.671626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:09.672248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:09.672761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:09.696753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:09.698795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:09.750362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:09.777051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:09.782234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:10.028370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:10.060132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:10.074891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:10.141036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ac0a5-31e4-4419-bf80-da5bf5e42640 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:10.165933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc78fe-e7ba-49d6-92bb-1d075f7dc087 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:10.181073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:10.181741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:10.182023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:10.182302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:10.183440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:10.185155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:10.186754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:10.193279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:10.202964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:10.203583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:10.203865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:10.204141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:10.204848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:10.206245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa224f82-2dd6-4be0-89fb-d6f99f2c9e7e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:10.220476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 06:46:10 2022] POST /identity/v3/roles => generated 223 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:46:10.317040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134e77d-f682-4e05-bce9-73b5ecf772db None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:10.329524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:10.356735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:10.357372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:10.357653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:10.357957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:10.358631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:10.360127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9564f-bd6e-4e7f-8b7e-26e6a043ed6c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:10.392100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:46:10 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:46:11.445320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74ac3-6898-47bb-ac7d-3e20b37d35d2 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:11.445822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74ac3-6898-47bb-ac7d-3e20b37d35d2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:11.445822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74ac3-6898-47bb-ac7d-3e20b37d35d2 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:11.447159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:11.452502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:11.452923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:11.453094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:11.471491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:11.473513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:11.538020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:11.808129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74ac3-6898-47bb-ac7d-3e20b37d35d2 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:11.866423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:11.907438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74ac3-6898-47bb-ac7d-3e20b37d35d2 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:11.940500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:11.941271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:11.941648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:11.941929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:11.953162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:11.959254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:11.960075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:11.960854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:11.966134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:12.080257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:12.089852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5291c6a-4591-4af9-b7bb-6796fec2c430 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:12.124208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:12.124847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.125130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.125405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.126080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:12.126384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:12.127771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:12.136893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:12.142517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:12.243357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7f535-8f84-4c6b-8d6a-9dea41012d9c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:12.262732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:12.278079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:12.278715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.278999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.279274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.280405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:12.281915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:12.283492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:12 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:12.289551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:12.387759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6ab0-09ae-4996-ae8b-cf6c8592bff6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:12.421656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:12.422277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.422552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.422819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.423913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:12.425455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dcf82-a08c-4610-842c-fdbe88a1afa8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:12.427322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:12.433397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:12.533453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5522cc-a24f-4cb0-8b99-5e7d13631025 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:12.557771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd739ae-0e35-4e98-ae5c-ee71d742e241 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd739ae-0e35-4e98-ae5c-ee71d742e241 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd739ae-0e35-4e98-ae5c-ee71d742e241 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.559822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 28/53] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:12.564762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.565049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.565326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.568517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:12.569157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:12.569442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:12.569712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:12.570439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.domain.id=default, user.id=1083a60a7d7244f7a16714f47f1d6e8f) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:12.570742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:12.572178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:12.580363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 26/54] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 13 06:46:12 2022] GET /identity/v3/role_assignments?user.id=1083a60a7d7244f7a16714f47f1d6e8f&scope.domain.id=default&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:12.585791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:12.587027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:12.606751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:12.664683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 29/55] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:12.943053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:12.994723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:13.042286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666124-e67f-4661-8705-c53f079b6587 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:13.073584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:13.074206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:13.074487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:13.074759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:13.075870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:13.077320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b8907-ac14-479e-a80f-27aff747a6e0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:13.078855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 27/56] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:13.085092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:13.179936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752389-7e14-4bd1-863f-8f0e402352ed None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:13.212506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:13.213075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:13.213353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:13.213618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:13.214263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:13.215690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931639ed-b637-4398-802c-9de1eabe79bf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:13.240008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 30/57] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 13 06:46:13 2022] POST /identity/v3/projects => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:15.370922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dce64-1850-4eb9-a83c-3e2410c14032 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:15.371411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dce64-1850-4eb9-a83c-3e2410c14032 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:15.371411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dce64-1850-4eb9-a83c-3e2410c14032 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:15.372761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 28/58] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:15.377782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:15.378162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:15.378961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:15.386093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:15.397534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:15.398697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:15.462925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:15.765920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dce64-1850-4eb9-a83c-3e2410c14032 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:15.966775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dce64-1850-4eb9-a83c-3e2410c14032 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:15.985910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:15.999049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:15.999670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:15.999945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:16.000217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:16.001337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:16.002750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83981a-bd0a-45ce-b473-915c89b53f52 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:16.004438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 29/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:16.010135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:16.106889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1bbe-4100-4c38-bc03-c4e029df657c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:16.139566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:16.140177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:16.140459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:16.140764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:16.141423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:16.142873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8f8b7-00b6-42d9-b296-973dce6b5c0e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:16.153390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:16.171298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:16 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:19.377778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f7e0-1d5b-49da-91b3-5aa139835937 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.379317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f7e0-1d5b-49da-91b3-5aa139835937 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.379826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f7e0-1d5b-49da-91b3-5aa139835937 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.381385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 30/62] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:19.386822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356bf4-4946-4ee7-abaf-e481d9e5316c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.387213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356bf4-4946-4ee7-abaf-e481d9e5316c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.387361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356bf4-4946-4ee7-abaf-e481d9e5316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.414517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a4356bf4-4946-4ee7-abaf-e481d9e5316c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:19.415892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a4356bf4-4946-4ee7-abaf-e481d9e5316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:19.511163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 33/63] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:19.627446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443d0-928f-4444-8c59-b1eedf9f7a7d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.627764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443d0-928f-4444-8c59-b1eedf9f7a7d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.628220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443d0-928f-4444-8c59-b1eedf9f7a7d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.629977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:19.641038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.641334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.641612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.666948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:19.668182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:19.716942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e977a6-571f-481a-b109-6414093ed510 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.717566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e977a6-571f-481a-b109-6414093ed510 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.718068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e977a6-571f-481a-b109-6414093ed510 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.719615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 32/65] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:19.725128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:19.725660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:19.726137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:19.745348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:19.746874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:19.775637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:19.827529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:19.892306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:19.960630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.021044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148825fc-5b58-4f96-ab8c-297cd50a3447 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.078345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.079280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.079738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.080185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.096269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:20.101933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:20.102799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:20.103558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:20.105536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:20.111443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.134460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.230024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537cd32-0415-4aa8-9a98-c2f644c087e3 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.245892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62728-0720-41f2-a5e4-fa3a915892bf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.249475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.258564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.272878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.273492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.273778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.274052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.274724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:20.275033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.276414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b97462-792d-4570-9c44-2ee39223ee54 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.285195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:20.285661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.286448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa83-35aa-44b4-8049-fe0936493f66 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.286656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.286751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa83-35aa-44b4-8049-fe0936493f66 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.286993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4fa83-35aa-44b4-8049-fe0936493f66 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.287345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.287770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.292553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 35/70] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:20.293347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4fa83-35aa-44b4-8049-fe0936493f66 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.300913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:20.306257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:20.307096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:20.307946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:20.309936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:20.313550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.400975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4fa83-35aa-44b4-8049-fe0936493f66 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.419114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989a9e5-331f-489c-a5c2-bb6dc97c7203 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.434652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.435273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.435554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.435827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.446153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-ce152d74-1793-4262-932b-7ec0e8b8a591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:20.450932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:20.451991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:20.452968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:20.453870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dc8-f03d-4d16-941f-89cb6aaf32ad None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.454111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dc8-f03d-4d16-941f-89cb6aaf32ad None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.454380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c5dc8-f03d-4d16-941f-89cb6aaf32ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.455793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.457593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.457747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.458021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.471585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.473436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6b1c5dc8-f03d-4d16-941f-89cb6aaf32ad None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:20.474208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.474740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6b1c5dc8-f03d-4d16-941f-89cb6aaf32ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:20.475842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:20.476628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.503515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.513665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.547522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 37/74] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:20.548811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901689-1472-4e29-96cf-7878a9d8fd9c None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.549102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901689-1472-4e29-96cf-7878a9d8fd9c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.549378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901689-1472-4e29-96cf-7878a9d8fd9c None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.555508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 38/75] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:20.555508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901689-1472-4e29-96cf-7878a9d8fd9c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.580494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0d513-3ab8-4225-9e50-903c0aa76e73 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.622666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.623280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.623559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.623833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.624502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:20.624855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.626250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.634953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:20.635600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.667417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901689-1472-4e29-96cf-7878a9d8fd9c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.702665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.703266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.703547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.703825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.704486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:20.704817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.706377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebee503-a93b-4288-aa04-6a21ae84b930 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.716218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:20.723206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.723493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.723776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.733868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.742609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:20.743828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:20.744719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccf84-fc35-479a-af45-0e68d331708e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.771241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.780500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.781160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.781536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.781812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.815110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:20.816283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.862193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.864366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.924343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a0ef-489d-47c9-8c91-bde7f8accca8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:20.959573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:20.960301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:20.960426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:20.960741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:20.961097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:20.962441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:20.963899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:20.965513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:20.966279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:20.973829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 39/80] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:20.975037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.001163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.076716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02043ac-f3c7-45d5-a4a2-699a0f588a65 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.090091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1bad4-12cd-4f1b-aa84-c9b8d2df827c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.114612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.115691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.116186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.116789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.117939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.119383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.124614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 42/81] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.124614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.127723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.128963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.129241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.129519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.139571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:21.144422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:21.145503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 40/82] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:21.146418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.197486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.220153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.224726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce68aeb-8517-4625-a6bf-777abfaab6cd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.248726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f56c1-a062-45e8-a50b-2daf31ab857b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.258476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.259088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.259365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.259638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.283503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.284068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.284531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.284925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.286093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.287558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.289225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.289992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.328273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.329815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.394857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875fdf-1a6b-4c10-8f1c-7e56a153bfea None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.412785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.429206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.431007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.431696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.431962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.432234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.433394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.434755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 43/84] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:21.434857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.436076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.436458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.441609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.535098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8e56-b71a-4d75-8af0-9f3d45fe022d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.539503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4737f2-8659-4297-8bab-8fd0fa193350 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.568225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.568867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.569150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.569429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.573130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.573731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.574007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.574274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.574932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:21.575234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.576613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.584932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.585639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.632070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.636346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.637890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.639154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.689696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957f30-5d49-44c1-90cc-1ea74b3da6f1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.728329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.728964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.729240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.729513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.730237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:21.730542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.731973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.736784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:21.744633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=65a7d60481ab48fbb33706644bf422bf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.744936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.745033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.860966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.865475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1629-2015-463a-a9ca-26c253a6631a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.867313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c74fbb-d4ee-4b1d-a2b6-85a54c951921 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:21.882238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:21.906259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.906908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.907193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.907473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.909571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.909673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:21.910343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:21.910630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:21.910732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.910908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:21.912059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:21.915916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:21.916044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:21.918322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:21.945317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 45/90] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:21 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:21.945317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:22.065045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30f64-9fc9-4aac-b91e-840806a65435 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.072590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348a9e9-b4ff-445e-9d61-97032a1d06a2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.114719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.115292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.115579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.115855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.117281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.118440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.118796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.119409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.119896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.120332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.120522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:22.121352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:22.122009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.123617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.132680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:21 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:22.135627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:22.167155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:22.188125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:22.247200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bf0c-f114-4194-a03d-22f14f8ad9a8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.265000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ed08-5008-4243-b954-68e7b3a2b5d1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.293779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.294468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.294755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.295097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.296136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:22.296136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.298404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.304924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:22 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:22.305761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:22.328019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.328741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.329025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.329301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.330049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=1083a60a7d7244f7a16714f47f1d6e8f) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:22.330357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.332386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.343792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 47/94] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:22 2022] GET /identity/v3/role_assignments?user.id=1083a60a7d7244f7a16714f47f1d6e8f&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:22.443779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:22.448156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8c00-806a-4a8f-b631-00907663982b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.504334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.505003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.505285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.505558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.593530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.595063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.716120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:22.725003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 48/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:22.726452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:22.840718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:22.844315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd440-3bde-455b-97b7-8b88fa2f3c9f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:22.887686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:22.888330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:22.888636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:22.888922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] PATH_INFO: `/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:22.890296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] RBAC: Authorizing `identity:get_project(project_id=6c63ed30f97e4c9bbb2b59b98a28cb68)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:22.891821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff2720-6b0a-4953-aa17-487186fb709f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:22.894403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:22 2022] GET /identity/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:22.900348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:23.036708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca19a-bf5e-43b9-b03c-97612da2e74b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:23.086051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:23.086685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:23.086969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:23.087245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:23.087988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=6c63ed30f97e4c9bbb2b59b98a28cb68, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:23.088302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:23.089792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6978a1-1e05-42cb-bd2c-3f5e76a3fb63 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:23.099680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:22 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=6c63ed30f97e4c9bbb2b59b98a28cb68&role.id=65a7d60481ab48fbb33706644bf422bf => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:24.834593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b37f38-ac70-4f2d-a461-47d67f3902df None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:24.835140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b37f38-ac70-4f2d-a461-47d67f3902df None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:24.835140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b37f38-ac70-4f2d-a461-47d67f3902df None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:24.836671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:24.842035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21605b-2ec9-475c-9d31-44a39bc6578b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:24.842443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21605b-2ec9-475c-9d31-44a39bc6578b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:24.842627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21605b-2ec9-475c-9d31-44a39bc6578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:24.864879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-de21605b-2ec9-475c-9d31-44a39bc6578b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:24.866081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de21605b-2ec9-475c-9d31-44a39bc6578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:24.927507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:24.936645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:25.193606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb654-e91a-4c87-8702-5a54af9ae0a7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.193814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb654-e91a-4c87-8702-5a54af9ae0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.194347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb654-e91a-4c87-8702-5a54af9ae0a7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.195890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 50/100] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:25.201234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.201742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.202260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.225293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:25.226778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:25.246240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb654-e91a-4c87-8702-5a54af9ae0a7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:25.329964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 51/101] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:25.441340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb654-e91a-4c87-8702-5a54af9ae0a7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:25.493433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:25.494114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.494493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.494788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.511799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c3a22bdd-df58-4cd8-b9c3-2f13fa154c11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:25.517369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:25.518273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:25.519112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:25.525926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:25.696571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d36ab-964d-490e-a381-7365c30fca43 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:25.708116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679df5-fb79-410a-ae6f-553231f41782 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.708653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679df5-fb79-410a-ae6f-553231f41782 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.709102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679df5-fb79-410a-ae6f-553231f41782 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.710595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 52/103] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:46:25.717198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f40a5-b834-4201-b31d-08b0f886ac75 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.717710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f40a5-b834-4201-b31d-08b0f886ac75 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.718181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f40a5-b834-4201-b31d-08b0f886ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.734572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:25.751481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-047f40a5-b834-4201-b31d-08b0f886ac75 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:25.751933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:25.752564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.752904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.753188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.754134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:25.754349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-047f40a5-b834-4201-b31d-08b0f886ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:25.754446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:25.755816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:25.772182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 52/104] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:25.777629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:25.792618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:25.864612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:25.865998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22aeb-bf76-4da4-9105-107cc7c5b432 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.866279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22aeb-bf76-4da4-9105-107cc7c5b432 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.866547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c22aeb-bf76-4da4-9105-107cc7c5b432 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.867772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 54/106] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:25.868606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c22aeb-bf76-4da4-9105-107cc7c5b432 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:25.909081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93d3c-39a3-4177-bfa1-8951be2fc7ba None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:25.952227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:25.953224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.953502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.953869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.956515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:25.958107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2249142-9d07-40fc-92c9-e5bb74fc868a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:25.960234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 53/107] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:25 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:25.961480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033514d-32a1-4bfb-a721-faff5669d0c3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.961762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033514d-32a1-4bfb-a721-faff5669d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.962029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033514d-32a1-4bfb-a721-faff5669d0c3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.963286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 54/108] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:25.964477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339432-81ce-4c1a-bee9-31decc95491c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:25.964783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339432-81ce-4c1a-bee9-31decc95491c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:25.965055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35339432-81ce-4c1a-bee9-31decc95491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:25.985836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-35339432-81ce-4c1a-bee9-31decc95491c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:25.987142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-35339432-81ce-4c1a-bee9-31decc95491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:26.000381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c22aeb-bf76-4da4-9105-107cc7c5b432 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.041551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.042193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.042472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.042744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.055308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.056665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:26.062829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:26.063698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:26.064590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:26.067174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:26.073666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.080808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:26.082103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.082428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.082716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.093631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.105153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:26.108217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:26.184871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 56/111] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:26.185966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.254764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6437-d791-4dca-b47c-1be1c68ebae8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.332490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ec51d-d5e8-4bff-b8cb-56d6aca39656 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.347515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.357851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.358507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.358795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.359070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.365289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.366774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.368637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 56/112] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:26.369746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.371709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.372568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.373103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.373600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.374481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:26.375093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.376733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.391683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:26.392756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.480215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.504999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3d497-7213-4d40-81f8-f5435b35df28 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.527744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf8537-43cc-4b73-8b24-4ba8f564ca1f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.540834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.541672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.541951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.542226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.553926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:26.558730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:26.559566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:26.560325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:26.561697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.569084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.569757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.570036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.570307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.572214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, user_id=8cdf4c1b6e3c4d9186a45a8ecd343659, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.573685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.600672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 58/115] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:26 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:26.600672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.632185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.697522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871211f-eb2b-44fe-84af-789521dc87d6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.717543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7e51-f3f4-4a1a-9953-89dee344a583 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.734741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.735508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.735791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.736059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] PATH_INFO: `/v3/users/15458f0f252e4c67956e4102b604c4ca` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.754512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] RBAC: Authorizing `identity:get_user(user_id=15458f0f252e4c67956e4102b604c4ca)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.756005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.757733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 58/116] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/users/15458f0f252e4c67956e4102b604c4ca => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:26.758178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.758499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.761311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.763818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.764153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.764409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.766290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.767784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.770005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 59/117] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:26.770786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.868359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d619f-4163-4006-8183-4f5f704edc39 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.876540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a6bb-b2c4-42ff-ad33-7addb8fe22c7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:26.879821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:26.907732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.908369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.908679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.908958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.912696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:26.913362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.913644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.913916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.914688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:26.914958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:26.916236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea833d8-3764-45a1-b305-84eaed8855dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:26.920228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:26.925167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 60/118] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:26.925447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:26.926289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:26.927339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 59/119] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:26.928002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.932803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1829-e9f1-4418-bc30-7ca28577e9e9 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:26.932803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1829-e9f1-4418-bc30-7ca28577e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:26.932803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1829-e9f1-4418-bc30-7ca28577e9e9 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:26.933136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 61/120] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:26.933939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1829-e9f1-4418-bc30-7ca28577e9e9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:26.993668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.036902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb2cd9-6b2d-43f2-9a40-ee0dff45221c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.050838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1829-e9f1-4418-bc30-7ca28577e9e9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.074042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.074894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.075324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.075598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.087126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.087755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.088039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.088311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.089015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.090468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.118091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 62/121] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:46:26 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:27.119060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.147484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.173757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.177137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f0885-83f7-41fd-998c-ed4cb01bdc90 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.245580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7311a91-91d4-435c-82c9-fe084c9d1d5d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.286295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.287017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.287375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.287726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.289075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.290709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.292450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:27.292883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.293422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.329691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 60/123] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:27.330919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.332736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.333094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.354219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:27.355533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:27.398372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.419136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b57f-627e-4e07-a491-19ae020d1bba None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.437309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 61/124] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:27.438554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.489328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.489997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.490272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.490585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.491283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:27.491590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.493106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.511852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 64/125] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:27.512825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.545263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.555707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4594-36d1-4086-a84c-a16f3b1a9fac None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.617166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.617813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.618096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.618369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.623189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.624989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.626637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 62/126] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:27.627399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.689867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0536a6-d03b-4d33-8253-ff96c416f69b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.745710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.746358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.746641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.746914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.748170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.749679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.751326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 65/127] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:27.752071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.789227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.816350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6bd-8660-4bc6-aa70-8302f93fa986 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.852320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.852994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.853280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.853557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.854753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.856251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.857923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:27.858741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.870937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db3cb-ac30-4a22-9ab8-bba186e64eb4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:27.888263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:27.910596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:27.911681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:27.912109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:27.912529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/1083a60a7d7244f7a16714f47f1d6e8f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:27.914752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, user_id=1083a60a7d7244f7a16714f47f1d6e8f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:27.916812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:27.934918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 66/129] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:27 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/1083a60a7d7244f7a16714f47f1d6e8f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:27.937171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:27.975119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78da632-30bb-4d89-96ca-279713009b7d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.031441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.032788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.033225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.033648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.035169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=15458f0f252e4c67956e4102b604c4ca) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:28.035386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:28.035843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.038547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.051066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/role_assignments?user.id=15458f0f252e4c67956e4102b604c4ca&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:28.051066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.080829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe81ab-74e9-4231-88a6-1a38015fc425 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.143251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.143251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.143251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.144229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.173096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:28.180045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:28.181238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:28.182177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:28.189075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 67/131] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:28.190130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.210718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:28.221543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510f23-2a75-4748-bd59-4411d00e4ac3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.265690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.267295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.267832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.268253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.270749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.272367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.274413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:28 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:28.281631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.400174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc1e31-a50c-4058-86c1-1c4420237bd5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.410313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681d070-f825-43c4-869d-67fb2f15b94f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.441462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.442486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.442917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.443340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.445777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, user_id=8cdf4c1b6e3c4d9186a45a8ecd343659, role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.447393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.465185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:28 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:28.476008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.476923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.477377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.477818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.478691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:28.479171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.480786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.488387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:28.491958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 68/134] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:28.498233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.553096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:28.610480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b310-4f13-4f7e-aabb-5a090d7cacf7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.649351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.649992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.650277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.650553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.651713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.653211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.655099 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 67/135] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:28 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:28.661043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.781945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075004a3-d2fd-43d0-9538-c46ebf7c6e76 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.820918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.821536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.821822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.822096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] PATH_INFO: `/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.823235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] RBAC: Authorizing `identity:get_project(project_id=6c63ed30f97e4c9bbb2b59b98a28cb68)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.824724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642f0e2-500b-4708-af30-e64860a0689b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.826565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 69/136] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:28 2022] GET /identity/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:28.833243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:28.927634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:28.940022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6761b6-6983-46d3-adcd-d949f110d9f5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:28.977501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:28.978184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:28.978500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:28.978750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] PATH_INFO: `/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:28.980829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=6c63ed30f97e4c9bbb2b59b98a28cb68, user_id=8cdf4c1b6e3c4d9186a45a8ecd343659, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:28.982338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7979b-9a25-4e3d-9a7a-23f3f6fa8e1a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:28.996497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:28 2022] PUT /identity/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68/users/8cdf4c1b6e3c4d9186a45a8ecd343659/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:29.482679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4847d1-2e4b-4d5e-8af3-79ed7be8bac7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:29.483226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4847d1-2e4b-4d5e-8af3-79ed7be8bac7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:29.483226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4847d1-2e4b-4d5e-8af3-79ed7be8bac7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:29.484778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:29.493627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769cef-c192-4b74-9a61-93f063b6c1c9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:29.493915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769cef-c192-4b74-9a61-93f063b6c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:29.494199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769cef-c192-4b74-9a61-93f063b6c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:29.521650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1f769cef-c192-4b74-9a61-93f063b6c1c9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:29.522882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1f769cef-c192-4b74-9a61-93f063b6c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:29.623107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:29.674475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64399f-d805-4155-8719-724fe030f7fb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:29.674736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64399f-d805-4155-8719-724fe030f7fb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:29.675068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64399f-d805-4155-8719-724fe030f7fb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:29.676723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 71/140] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:29.682409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:29.682906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:29.683348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:29.702196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:29.703618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:29.787383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:30.033895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64399f-d805-4155-8719-724fe030f7fb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.074413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.090439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:30.121861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:30.157212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64399f-d805-4155-8719-724fe030f7fb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.197911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.198571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.198854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.199130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.211817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:30.217589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:30.218448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:30.219215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:30.226257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.298254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38b7c1-650e-4934-8aee-0c8ed12e9db8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.361376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.361945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.362303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.362592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.363910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:30.365405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:30.366995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 71/143] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:30.373106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.397614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522ce5-f5fc-43db-89a3-be2c70b452e3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.448659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:30.458717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:30.466713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.467448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.467727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.467998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.468704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:30.469132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:30.471445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:30.482529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eba51a-a8e8-41de-a212-8865dc01ffbe None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.486091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:30.492692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.517799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.518672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.519010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.519436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.520079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:30.521606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:30.563372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 72/145] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:30 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:30.634317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164504-edb0-4491-a9bd-67ad705f430f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.685824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.686502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.686779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.687048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.689311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:30.692003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:30.694078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:30 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:30.700231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:30.841232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe744c-2c70-42a4-94ea-7fe03ef9efd2 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:30.877539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:30.879164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:30.879534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:30.879882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:30.897992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:30.986732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:30.989080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:31.239945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:31.245583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:31.341765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:31.402052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b8887-d4d3-45ed-8ccd-ed5f24cfcca6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:31.444771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:31.445420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.445701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.445975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.452885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:31.454369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0068-d5a3-4725-ba87-fe07c289ace1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:31.456141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:31 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:31.462371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:31.497826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:31.584856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e7e9-dfcd-4c85-a1ad-7c4c4be5fb4d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:31.625466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:31.626103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.626387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.626663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.627420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:31.627789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:31.629396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d05c4-02b0-469d-a0c9-4be3bbf348b6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:31.638186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:31 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=65a7d60481ab48fbb33706644bf422bf => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:31.652162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ba52-7bcc-4247-a9db-0aaac9fbaaed None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.652688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ba52-7bcc-4247-a9db-0aaac9fbaaed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.652760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724ba52-7bcc-4247-a9db-0aaac9fbaaed None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.654207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 76/150] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:31.660785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d26cc-c949-4a70-8994-a82294f07a43 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.661398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d26cc-c949-4a70-8994-a82294f07a43 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.661863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d26cc-c949-4a70-8994-a82294f07a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.683288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-066d26cc-c949-4a70-8994-a82294f07a43 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:31.684843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-066d26cc-c949-4a70-8994-a82294f07a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:31.758370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:31.861694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1070-eae7-465e-bf7e-e30059454ab3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.862006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1070-eae7-465e-bf7e-e30059454ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.862816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1070-eae7-465e-bf7e-e30059454ab3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.864410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 77/152] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:31.882259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60751-501a-49a1-8fe3-8ad2b622d77e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:31.882861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60751-501a-49a1-8fe3-8ad2b622d77e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:31.883347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60751-501a-49a1-8fe3-8ad2b622d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:31.910086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-05c60751-501a-49a1-8fe3-8ad2b622d77e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:31.911636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-05c60751-501a-49a1-8fe3-8ad2b622d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:31.938749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:31.989938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:32.287712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1070-eae7-465e-bf7e-e30059454ab3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:32.341912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56199a45-9e0e-4aef-968c-3ca4e0cdbda5 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:32.342409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56199a45-9e0e-4aef-968c-3ca4e0cdbda5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:32.342662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56199a45-9e0e-4aef-968c-3ca4e0cdbda5 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:32.344080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 77/154] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:32.349831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:32.350221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:32.350392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:32.386645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:32.387862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:32.481838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1070-eae7-465e-bf7e-e30059454ab3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:32.514668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 78/155] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:32.524433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:32.528616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:32.550515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:32.551268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:32.551542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:32.552064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:32.588939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:32.593856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:32.594751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:32.595549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 78/156] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:32.605645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:32.644970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:32.668149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78719a-c5be-461e-be8a-d4ed99a6879b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:32.726251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:32.727221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:32.727696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:32.728109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:32.751157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:32.761736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:32.763070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:32.764101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:32.766210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 79/157] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:32.773666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:32.792053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c5304-9ae0-4ab2-82da-a4f8865caf1e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:32.869391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:32.869946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:32.870225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:32.870496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:32.871174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:32.871471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:32.872901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:32.886899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 79/158] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:32.892242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:32.970332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.040924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19622-509e-48f2-8dc6-e722ee5d79d1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.062499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c304750-f0dc-46e6-8ec8-13fca8f5b09e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.076072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.076737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.077020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.077293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] PATH_INFO: `/v3/users/15458f0f252e4c67956e4102b604c4ca` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.078537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] RBAC: Authorizing `identity:get_user(user_id=15458f0f252e4c67956e4102b604c4ca)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.079984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.082136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 80/159] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:32 2022] GET /identity/v3/users/15458f0f252e4c67956e4102b604c4ca => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:33.082911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.162353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.162893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.163174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.163443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.164122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:33.164424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.165917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46dce3-3811-4e27-a68c-7044ece7efc1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.182082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:33.183325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d66f-cbeb-4282-941f-663c03cc57c7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.183613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d66f-cbeb-4282-941f-663c03cc57c7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.183886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d66f-cbeb-4282-941f-663c03cc57c7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.189826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394bdd-c10c-4c3d-9e63-40b57fef8b55 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.192556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 81/161] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:33.193359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d66f-cbeb-4282-941f-663c03cc57c7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.211903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.216979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.231215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.232427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.232739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.233013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.251368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:33.257011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:33.257891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:33.258718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:33.259326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 81/162] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:33.259900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.374434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f877bd7-9a7d-4e90-be49-b9ce29605cf4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.411598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.412238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.412569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.412848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] PATH_INFO: `/v3/users/1083a60a7d7244f7a16714f47f1d6e8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.414198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] RBAC: Authorizing `identity:get_user(user_id=1083a60a7d7244f7a16714f47f1d6e8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.415780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36d44-5ec0-49d0-b328-db2b15012429 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.417744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 82/163] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/users/1083a60a7d7244f7a16714f47f1d6e8f => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:33.419197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.419480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.419747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.439869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:33.442889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:33.488943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.519373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 83/164] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:33.520037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.569356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d66f-cbeb-4282-941f-663c03cc57c7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.631342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e0378-e7aa-4d56-9b6c-a7d649ab69c4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.671785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.672331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.672629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.672905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.673765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:33.674071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.676554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.685942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 84/165] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:33.686907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.714319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.714974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.715253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.715530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.721266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.723393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.723923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.725096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 82/166] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:33.725864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:33.803238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065350f-5004-4560-89ed-c74b0bcd8650 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:33.840654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:33.841310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:33.841585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:33.842098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:33.921189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:33.922774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:33.974133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:33.974925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:34.013186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456c01f-3911-4875-bb18-f8299c590e08 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.063143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 85/167] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:34.064965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.079713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.080741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.081770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.082247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.083652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:34.085343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:34.089420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 83/168] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:33 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:34.091762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.205306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f47c-d3ae-4d0d-b02e-2150171480ad None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.266783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.267849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.268469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.269170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/15458f0f252e4c67956e4102b604c4ca/roles/9392a2850e27457c9313cd7cc0faf77b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.271731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, user_id=15458f0f252e4c67956e4102b604c4ca, role_id=9392a2850e27457c9313cd7cc0faf77b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:34.273712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:34.276320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:34.292475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 86/169] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:34 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/users/15458f0f252e4c67956e4102b604c4ca/roles/9392a2850e27457c9313cd7cc0faf77b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:34.298045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.331102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611b6f-fefc-4bad-a670-a042a88a44e4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.445334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.445998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.446283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.446558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.469303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:34.475322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:34.476289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:34.477119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 84/170] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:34.477861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.500970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:34.530596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3966c-5320-4c7d-bc1a-68b4e26b5fad None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.600409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.601505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.602008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.602479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.603939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:34.605792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd9be4-c32c-432e-ae76-fe178c2a460e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:34.608008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:34 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:34.609628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077db6-70b3-4982-aecd-4da33f691187 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.610244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077db6-70b3-4982-aecd-4da33f691187 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.610729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077db6-70b3-4982-aecd-4da33f691187 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.612698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 88/172] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:34.613618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077db6-70b3-4982-aecd-4da33f691187 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.614927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed108cc-d33e-49fd-a685-85c28c14a922 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.657734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.658349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.658624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.659067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.689298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:34.745928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:34.747745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1ac19-1d46-4664-89de-f3d0c0721567 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:34.751325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:34.785969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077db6-70b3-4982-aecd-4da33f691187 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.841109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:34.842554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.843032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.843506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.844461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:34.845041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:34.846733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:34.856447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:34.861771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:34.939640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 85/174] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:34.949505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:34.949797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:34.950068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:34.975475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99404e12-db48-4e0a-b7c6-54e58bd8df8a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:34.978139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:34.979444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:35.001289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.014968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:35.015975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.016618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.016956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.017769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=1083a60a7d7244f7a16714f47f1d6e8f) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:35.018195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:35.019989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:35.027052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 90/175] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:34 2022] GET /identity/v3/role_assignments?user.id=1083a60a7d7244f7a16714f47f1d6e8f&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:35.027781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:35.095592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 86/176] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:35.097298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:35.139497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.248549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e058b-d7b4-428f-b8f2-baf84ec782dc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:35.264054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db196-19a7-4a35-b234-4781c6a6fa7c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:35.315047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:35.315890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.316165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.316431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.318057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:35.319620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:35.321601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 87/177] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:35 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:35.328641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:35.350953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:35.351613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.351889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.352158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] PATH_INFO: `/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.357454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdf4c1b6e3c4d9186a45a8ecd343659)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:35.358949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:35.360998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 91/178] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:35 2022] GET /identity/v3/users/8cdf4c1b6e3c4d9186a45a8ecd343659 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:35.367108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:35.478597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0bcfc-9cb4-4f35-8e81-720d68f6c67d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:35.484131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.488991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.520287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:35.521270 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.521751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.522175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.523109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:35.523571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:35.525949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee838f-33b3-40ac-85b3-4e28978e7771 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:35.532837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 88/179] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:35 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:35.534359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a8b2-38a8-4a29-9ad2-39ff2f80be4e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.534831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a8b2-38a8-4a29-9ad2-39ff2f80be4e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.535280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a8b2-38a8-4a29-9ad2-39ff2f80be4e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.536779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 89/180] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:35.538293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc913a-b758-4d1f-a099-7d2aed92a1c7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.538740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc913a-b758-4d1f-a099-7d2aed92a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.539168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc913a-b758-4d1f-a099-7d2aed92a1c7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.540619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 90/181] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:35.544649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f9d3-322b-4ebc-b091-54da1d722b15 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.545126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f9d3-322b-4ebc-b091-54da1d722b15 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.545873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3f9d3-322b-4ebc-b091-54da1d722b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.558645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245b07-4ae0-4c11-be2a-8d352388a9a9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:35.568213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-13c3f9d3-322b-4ebc-b091-54da1d722b15 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:35.569824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-13c3f9d3-322b-4ebc-b091-54da1d722b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:35.615973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:35.616696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.617036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.617376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.661997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:35.664260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:35.665193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:35.665688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:35.698751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:35.700543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:35.787122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 92/183] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:35.788295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:35.789355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:35.793500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:35.851080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.910844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:35.963475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d1b57-9728-4cec-8ece-4af2fbb1297e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:35.999553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 92/184] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:36.001014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.001631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.001908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.002175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.005595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.014454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:36.020615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:36.021490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:36.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 93/185] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:36.033380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.128957 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.137856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571056-1ef9-4780-a826-1cf2f35569de None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.145251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a2e8e-d8e3-4006-a86f-4c64d286d330 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.173292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.173922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.174224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.174493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] PATH_INFO: `/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.175613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] RBAC: Authorizing `identity:get_project(project_id=6c63ed30f97e4c9bbb2b59b98a28cb68)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.177394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.180691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 93/186] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/projects/6c63ed30f97e4c9bbb2b59b98a28cb68 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.180691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.187125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.187737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.188015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.188287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.188984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:36.189287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.190821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.203502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 94/187] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:36.203502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.213112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.290278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd201d86-64a2-4224-8fa4-2695c30eaf52 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.316454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90217-3b56-46f5-b50d-f74ad994210e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.326408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.327070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.327353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.327629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.338161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:36.343003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:36.343875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:36.344696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 94/188] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:36.345375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.358691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.359334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.359617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.359893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.361044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.363018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.369105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 95/189] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.369947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.388937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.435629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.452047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43dd47-fbc2-4ede-861e-f25645da6a1f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.480342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf244ed-5515-415e-921a-c77b641ce902 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.488726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.489344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.489623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.490269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.491008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=6c63ed30f97e4c9bbb2b59b98a28cb68, user.id=8cdf4c1b6e3c4d9186a45a8ecd343659) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:36.491636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.494922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.512938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 95/190] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/role_assignments?user.id=8cdf4c1b6e3c4d9186a45a8ecd343659&scope.project.id=6c63ed30f97e4c9bbb2b59b98a28cb68&role.id=65a7d60481ab48fbb33706644bf422bf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.513777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.516059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.516751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.517029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.517300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.543763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.546688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.550113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 96/191] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.551514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.633399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f06d1f-e38d-4b59-89d1-f00233eccafe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.649427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.680924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268afc5-9c3c-46fe-8810-e3ee5eea6823 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.684748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.685460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.685802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.686147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.686896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:36.687268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.688760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.701385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 96/192] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.705685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.723278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.726580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.727253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.727636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.728205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.729154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.731187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.757466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 97/193] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:36 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:36.758371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.863042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a3e27-7b3f-4936-b79d-252ff2466cb0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.904931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.905480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.905761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.906040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.914329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6025-9435-4249-8e84-da31f5817412 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:36.947862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:36.954640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:36.956309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:36.958448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:36.959028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:36.960731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.962581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.964513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 98/194] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:36.970668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:36.985636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:36.987806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874e76d-2d67-4ad6-94c5-f588b70ee20d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:36.999950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:37.094897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbfd5-5a42-42c2-b5d1-5ddc2e09e0bc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.116097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 97/195] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:37.117074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c62be-bd5a-4a72-8f9c-8c62f9e82fd7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.117361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c62be-bd5a-4a72-8f9c-8c62f9e82fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.117633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c62be-bd5a-4a72-8f9c-8c62f9e82fd7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.120547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 98/196] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:37.121973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c62be-bd5a-4a72-8f9c-8c62f9e82fd7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:37.137213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.138061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.138486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.138920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.222066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:37.228175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:37.230114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:37.249775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c62be-bd5a-4a72-8f9c-8c62f9e82fd7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.264955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:37.295697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.296500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.296826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.297101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.298868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:37.300537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c6beb-62f0-46bc-b497-e20631ed3bed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:37.303390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:37.309076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.309365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.309646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.329548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:37.330795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:37.344737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:37.346038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:37.404220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:37.405299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:37.448866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:37.453470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff04f-2919-4379-a76e-fdf3fff6373e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.489632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.490580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.491059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.491528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.492487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=ae1003608554470f9fd4d6f2ba61ff38) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:37.493029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:37.494678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:37.500796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/role_assignments?user.id=ae1003608554470f9fd4d6f2ba61ff38&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:37.524284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d81075-3465-4c84-be05-7500791d53eb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.536000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:37.565686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.566707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.567209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.567680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.569241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:37.570949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:37.573248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:37.582301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:37.700478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7a472-c2b7-4e15-97e9-0d1767b3d799 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.740463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.741454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.741937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.742408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.743354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=ae1003608554470f9fd4d6f2ba61ff38) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:37.743971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:37.745786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:37.752350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/role_assignments?user.id=ae1003608554470f9fd4d6f2ba61ff38&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:37.775298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:37.913377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd67e-2e76-40c9-8c39-f8019ff7c8c2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:37.964995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:37.965636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:37.965916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:37.966186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:37.977389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:37.982262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:37.983139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:37.983949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:37.989407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:38.025457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:38.104767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8dc4c-e556-49be-bcc8-5902ccbc692c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:38.150536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:38.151162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:38.151444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:38.151719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:38.152398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:38.152733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:38.154173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:38.168098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:38.174116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:38.217206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:38.288096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88396-c301-4a0b-9c62-76d11febe4c1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:38.334504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:38.335145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:38.335422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:38.335690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] PATH_INFO: `/v3/users/15458f0f252e4c67956e4102b604c4ca` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:38.336848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] RBAC: Authorizing `identity:get_user(user_id=15458f0f252e4c67956e4102b604c4ca)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:38.338352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:38.340151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:38 2022] GET /identity/v3/users/15458f0f252e4c67956e4102b604c4ca => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:38.345897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:38.449503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:38.472466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cacd-6739-4500-a193-49d6ef51dc6e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:38.518274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:38.518985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:38.519449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:38.519728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:38.604358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:38.605869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:38.727973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:38.744911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:38.750770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:38.871713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36d6f-6927-483b-bf3c-905aefa52f4d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:38.874059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:38.919136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:38.919776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:38.920056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:38.920331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:38.925385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:38.927110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de4c1-6e0f-4a53-9f14-71edcf956266 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:38.928943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:38 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:38.934976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:39.074766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba963-dff7-4966-a09b-8b1920c2683d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:39.110804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:39.111416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:39.111695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:39.111994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:39.112814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, scope.project.id=a19ff4e3b7d44dd385893859386e8995, user.id=15458f0f252e4c67956e4102b604c4ca) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:39.113118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:39.114559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337d3c6-5634-4e48-9f3a-accaddd77a71 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:39.120793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:38 2022] GET /identity/v3/role_assignments?user.id=15458f0f252e4c67956e4102b604c4ca&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:39.706766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d30a-1b5b-4a9d-b255-6b999eddabca None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:39.706766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d30a-1b5b-4a9d-b255-6b999eddabca None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:39.706766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d30a-1b5b-4a9d-b255-6b999eddabca None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:39.707865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:39.712361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694140d-75eb-4c5a-9842-46c28137742f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:39.712970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694140d-75eb-4c5a-9842-46c28137742f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:39.713459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694140d-75eb-4c5a-9842-46c28137742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:39.735097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4694140d-75eb-4c5a-9842-46c28137742f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:39.737239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4694140d-75eb-4c5a-9842-46c28137742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:39.798623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:39.821432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:39.902685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705d79-cf2c-4552-afe1-c2267b6d468a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:39.903108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705d79-cf2c-4552-afe1-c2267b6d468a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:39.903387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a705d79-cf2c-4552-afe1-c2267b6d468a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:39.905131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:39.911170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459526-1d59-49a4-a2d7-e05d8c17c3e1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:39.911457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459526-1d59-49a4-a2d7-e05d8c17c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:39.911731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6459526-1d59-49a4-a2d7-e05d8c17c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:39.931915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a6459526-1d59-49a4-a2d7-e05d8c17c3e1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:39.933139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a6459526-1d59-49a4-a2d7-e05d8c17c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:40.014823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:40.103249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705d79-cf2c-4552-afe1-c2267b6d468a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.115801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227eef2-8a7c-4432-8cbc-719bb6edfe3d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.116082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227eef2-8a7c-4432-8cbc-719bb6edfe3d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.116350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227eef2-8a7c-4432-8cbc-719bb6edfe3d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.117722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 107/213] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:40.123782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.124059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.124323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.142955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:40.144922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:40.226733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 108/214] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:40.229901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a705d79-cf2c-4552-afe1-c2267b6d468a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.266480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.267377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.267830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.268490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.269887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:40.271530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:40.273326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:40.278909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.307034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.329475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.353901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.395469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e3d2-5ec5-48fa-bef0-7237b4eb55db None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.428663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6688ef-438a-41de-b551-8b5c9d09e786 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.431315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.432028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.432312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.432614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.433263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:40.434713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385bab-2648-4b7c-ba97-defcef17cabf None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:40.460458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 109/216] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:40 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:40.461717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c213-86d2-4398-bb51-465dda033d37 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.462001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c213-86d2-4398-bb51-465dda033d37 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.462275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c213-86d2-4398-bb51-465dda033d37 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.463677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 110/217] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:40.469215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.469506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.469784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.474906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.475875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.476406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.476878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.489119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:40.489313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:40.490708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:40.495043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:40.495980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:40.496907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:40.499456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 108/218] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:40.506524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.581563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:40.581563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.625459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.627922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.633530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68584e-dea5-4cc1-af09-8244b799504a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.685198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.686106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.686576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.687041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.687893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:40.689195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:40.691174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:40.700627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 109/220] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:40.709135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.715231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac1653-ca09-4732-88fd-7e30848043bb None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.763064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.764463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.764985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.765444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.779927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:40.787059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:40.787977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:40.788909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 112/221] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:40.793948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.834121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39232f3-7193-43aa-abf7-b8c6763ec4b8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.876011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.876764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.877042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.877304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] PATH_INFO: `/v3/users/66266d3974314699a5c01cd9416b9d6a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.897496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] RBAC: Authorizing `identity:get_user(user_id=66266d3974314699a5c01cd9416b9d6a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:40.898979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:40.901234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 110/222] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/users/66266d3974314699a5c01cd9416b9d6a => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:40.902023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:40.907058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.918995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad352af-f503-486f-97ca-694bb07bbf4c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:40.933356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:40.962531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:40.963419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:40.963697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:40.964491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:40.965487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:40.965795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:40.967326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:40.977636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 113/223] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:40.978298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.025843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef58f6d-ae36-4661-8315-61edf80eccf3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.069771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.070947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.071220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.071480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.085458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:41.091660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:41.092564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:41.093397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:41.094008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 111/224] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:41.094606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.116482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06a72-6267-4da8-81f9-e6ec70371e55 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.158302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.159439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.160102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.160385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.184647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.204867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.231714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4796c15-74b2-479e-b490-c3c17c76a060 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.243251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.244882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.280225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.280901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.281178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.281449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.285084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.286649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.288309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:41.289120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.359725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:41.360702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.411464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94137c-f806-4d8b-9df8-33b086d44ff5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.425378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.449472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.450091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.450367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.450640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.451345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:41.451604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.453281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.461895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:41.462730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.476042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.486497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d88b-c7f0-4eb5-b5ea-b13c5f769d7f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.526880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.527914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.528382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.528862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.530608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.532567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.534868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:41.535982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.579045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f336c9-44b6-4e7e-8df4-600bd57b42de None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.633031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.634369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.634863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.635571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.637717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.639976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.642197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:41.644737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.662293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14304f-073c-48ba-82d2-ea6d3241408f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.686933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.710459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.711485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.712011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.712427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.714009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.715739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.724475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:41.724475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.751927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:41.776080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e1312-3954-4ffb-86e1-f6105f907207 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.812052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.812228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.812473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.812705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/users/ae1003608554470f9fd4d6f2ba61ff38/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.814836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, user_id=ae1003608554470f9fd4d6f2ba61ff38, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.816893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.833626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:41 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/users/ae1003608554470f9fd4d6f2ba61ff38/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:41.835227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:41.849344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba43dd-0288-4d78-a6a8-a6b803ef478b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:41.932550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:41.933110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:41.933390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:41.933660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:41.934399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=66266d3974314699a5c01cd9416b9d6a) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:41.934711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:41.936260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:41.951429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/role_assignments?user.id=66266d3974314699a5c01cd9416b9d6a&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=65a7d60481ab48fbb33706644bf422bf => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:42.033241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa77e0-f437-4d21-8735-3a3cb5a4a224 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:42.102951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:42.103615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:42.103898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:42.104173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:42.105474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:42.106971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21770327-52ec-49bf-ad74-c42b7818c244 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:42.108833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:41 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:42.114985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:42.182227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:42.233737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9772a-e3c0-4c40-90f5-1a5829a87296 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:42.269223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:42.269888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:42.270166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:42.270493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/users/ae1003608554470f9fd4d6f2ba61ff38/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:42.272804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, user_id=ae1003608554470f9fd4d6f2ba61ff38, role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:42.274356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98788bd-f70b-42c8-b57a-fad9cd531667 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:42.289730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:42 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/users/ae1003608554470f9fd4d6f2ba61ff38/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:43.055939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6e94a-e2af-4c7c-bd98-51b52f0504cf None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.056445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6e94a-e2af-4c7c-bd98-51b52f0504cf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.056519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6e94a-e2af-4c7c-bd98-51b52f0504cf None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.057884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:43.074228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.074745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.074824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.099306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:43.100512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:43.137007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4703e91-35dd-4133-947d-3ab4e3489a2d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.137483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4703e91-35dd-4133-947d-3ab4e3489a2d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.137771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4703e91-35dd-4133-947d-3ab4e3489a2d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.139128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 118/236] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:43.145633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.146055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.146435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.179621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:43.181972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:43.187616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:43.188983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:43.270879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:43.490863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:43.545190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:43.606854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5d53-92e7-48df-928b-f9e0fa825ce0 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:43.645315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec594a-167f-4359-a242-44103784800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:43.645672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:43.646531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec594a-167f-4359-a242-44103784800f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.647008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec594a-167f-4359-a242-44103784800f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.647479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec594a-167f-4359-a242-44103784800f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.660833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec594a-167f-4359-a242-44103784800f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-52ec594a-167f-4359-a242-44103784800f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:43.668175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:43.669197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:43.669992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:43.676296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:43.680511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec594a-167f-4359-a242-44103784800f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:43.812229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4835938-0297-4f90-ba79-f8215d98cefc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:43.879989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:43.880668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:43.883278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.884698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.886750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.888692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec594a-167f-4359-a242-44103784800f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:43.889829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:43.891496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:43.904500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:43.910174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:43.915216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:43.939211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:43.940923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:43.941464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:43.941934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:43.942888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:43.943748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:43.949794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:43.970315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:43.974873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:44.089576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ebfa8-6d15-40aa-9a91-4e2f8aac269c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:44.163059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:44.165214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.165700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.166201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.167195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:44.168881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:44.187391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab13c2e-2159-4721-8e66-b29d98499e9e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:44.198105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 121/242] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:43 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:44.270433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:44.271094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.271377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.271652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] PATH_INFO: `/v3/users/04eaff7a0d614ed9be0036019b519b9b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.295362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] RBAC: Authorizing `identity:get_user(user_id=04eaff7a0d614ed9be0036019b519b9b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:44.296905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a933f04-7170-4204-b9e6-c86925ce997a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:44.298890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 122/243] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:43 2022] GET /identity/v3/users/04eaff7a0d614ed9be0036019b519b9b => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:44.304643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:44.398403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.453667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b4bfa-dba5-4b7f-b075-0c34503f5808 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:44.506360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:44.506997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.507278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.507558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.588744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:44.590135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:44.652269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.676427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a459-1aec-45e5-b947-ef3632e3244a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.676756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a459-1aec-45e5-b947-ef3632e3244a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.677282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3a459-1aec-45e5-b947-ef3632e3244a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.680100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 123/244] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:44.686775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697dcbb-cbc8-47bb-a881-b287d1c19fe4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.687130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697dcbb-cbc8-47bb-a881-b287d1c19fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.687779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697dcbb-cbc8-47bb-a881-b287d1c19fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.709913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3697dcbb-cbc8-47bb-a881-b287d1c19fe4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:44.711127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3697dcbb-cbc8-47bb-a881-b287d1c19fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:44.712363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:44.718505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:44.730519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:44.816942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 124/246] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:44.842414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa862b27-3f85-46ae-b355-a1535404127f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:44.879092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd2c4-192d-4de1-839e-61edd247ebfc None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.879392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd2c4-192d-4de1-839e-61edd247ebfc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.879767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd2c4-192d-4de1-839e-61edd247ebfc None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.881060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:44.881753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.882047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.882319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.883504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:44.885024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:44.885574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 125/247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:44.886910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 123/248] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:44 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:44.891393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4158-4388-499d-958f-206b0e529da6 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:44.891681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4158-4388-499d-958f-206b0e529da6 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:44.891957 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a4158-4388-499d-958f-206b0e529da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:44.896245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:44.914516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-211a4158-4388-499d-958f-206b0e529da6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:44.916145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-211a4158-4388-499d-958f-206b0e529da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:44.933301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:45.003251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 126/249] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:45.043437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fee76-eded-4608-a38e-9bf4e253a377 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.081176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.081724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.082185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.082458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.083197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=04eaff7a0d614ed9be0036019b519b9b) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:45.083502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:45.085042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72158ee4-8bb3-41ef-b072-ff02c37c1923 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:45.091428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 124/250] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:44 2022] GET /identity/v3/role_assignments?user.id=04eaff7a0d614ed9be0036019b519b9b&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:45.106930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815afcb-5493-4cad-99f2-9de58ad5a5b3 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.107204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815afcb-5493-4cad-99f2-9de58ad5a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.107485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815afcb-5493-4cad-99f2-9de58ad5a5b3 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.110634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 127/251] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:45.115953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507568be-d168-4685-903b-91d477135734 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.116295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507568be-d168-4685-903b-91d477135734 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.116493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507568be-d168-4685-903b-91d477135734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.139113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-507568be-d168-4685-903b-91d477135734 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:45.140614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-507568be-d168-4685-903b-91d477135734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:45.163497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815afcb-5493-4cad-99f2-9de58ad5a5b3 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.228663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 125/252] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:45.273621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:45.298466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815afcb-5493-4cad-99f2-9de58ad5a5b3 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.318467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507568be-d168-4685-903b-91d477135734 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.338958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.340347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.340648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.340922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.366221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:45.366830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:45.373685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:45.374599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:45.375393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 128/253] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:45.381144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.516038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507568be-d168-4685-903b-91d477135734 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.568026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fed10b-6222-4c21-afec-8e7776c71858 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.580422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.581892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.582190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.582658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.604085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:45.612723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.612723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.612723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.612723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.613353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:45.613539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:45.614987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:45.616523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:45.617467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:45.618275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:45.624603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 129/254] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:45.625083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.625290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 126/255] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:45.629278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:45.631109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.755506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:45.797277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cac0-62c1-4df8-b919-12fbbe46befe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.832068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aec4a-b23a-44e5-a1a8-58230b2e8fc7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:45.862994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.863392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.863669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.863937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.864643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:45.864954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:45.866357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:45.874640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:45.875285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:45.875564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:45.875836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:45.882259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 127/256] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:45.883126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:45.892097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:45.899492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:45.900431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:45.901278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 130/257] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:45.902002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.015671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.080297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11818b7-58b6-4145-9d84-36b18e2be9a3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.095573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e1514-a698-4e33-a123-f10f4126fccf None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.151809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.152493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.152749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.153020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.154303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.155749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.157355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 128/258] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:46.162707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.166752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.167411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.167687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.167956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] PATH_INFO: `/v3/users/66266d3974314699a5c01cd9416b9d6a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.170230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] RBAC: Authorizing `identity:get_user(user_id=66266d3974314699a5c01cd9416b9d6a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.177795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.179794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:45 2022] GET /identity/v3/users/66266d3974314699a5c01cd9416b9d6a => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:46.181716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.197336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.289308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff4a4e-a5b5-4b46-88c9-fc5f8365f392 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.324993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.325674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.325948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.326211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.326919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:46.327219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.328612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.342029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:46.342851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.416289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbb3a-d993-4325-940e-d5720cb9ceb6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.424212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.452641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18fdf7-eb73-4170-a010-fce311c514bc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.487549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.488181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.488455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.488751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.489907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.490083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.491463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.493118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 130/261] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:46.493975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.501815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.502993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.503484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.504043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.601037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180da40-b692-401b-9467-ff93b51f3efc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.636895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.637575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.637853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.638122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] PATH_INFO: `/v3/users/ae1003608554470f9fd4d6f2ba61ff38` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.639235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1003608554470f9fd4d6f2ba61ff38)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.640696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.642271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 131/262] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/users/ae1003608554470f9fd4d6f2ba61ff38 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:46.648216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.662182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.698196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.699888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.756216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e2126-d92c-4dce-88b3-403b6fe73c16 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.791241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.791945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.792223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.792491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/users/66266d3974314699a5c01cd9416b9d6a/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:46.794400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, user_id=66266d3974314699a5c01cd9416b9d6a, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:46.795826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:46.811694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 132/263] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:46 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/users/66266d3974314699a5c01cd9416b9d6a/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:46.812914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.890563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 132/264] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:46.894473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.897281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:46.932630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab9ec-b3f2-49f0-b63f-f34b8588ef66 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:46.940941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:46.977965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:46.978977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:46.979405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:46.979829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:47.032635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968111c-8d0c-44a5-aee4-86b5480fe2ef None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:47.097800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:47.098007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:47.098632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:47.098912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:47.099189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:47.099303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:47.101507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:47.104079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:47.106053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 133/265] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:47.112036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:47.194020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:47.260542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 133/266] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:47.264918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:47.266161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:47.267408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2027fb3-590b-43e0-8c86-c678f45632bd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:47.329108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:47.330028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:47.330655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:47.331065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:47.331894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=ae1003608554470f9fd4d6f2ba61ff38) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:47.332298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:47.334162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:47.348329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 134/267] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:47 2022] GET /identity/v3/role_assignments?user.id=ae1003608554470f9fd4d6f2ba61ff38&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:47.421231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56ac1-152e-41fa-be8b-075245d28aee None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:47.471652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:47.472528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:47.472975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:47.473410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:47.474890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:47.476550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc64ff-0758-44ee-9c1e-9b212e57c961 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:47.478760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:47 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:47.484599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:47.634046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891640-b5e6-47a4-807b-9ddcde2c6930 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:47.682394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:47.683009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:47.683307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:47.683578 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:47.684307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=ae1003608554470f9fd4d6f2ba61ff38) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:47.684705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:47.686156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73d4c-f247-48e6-a296-4b8aa58162c0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:47.693221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 135/269] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:47 2022] GET /identity/v3/role_assignments?user.id=ae1003608554470f9fd4d6f2ba61ff38&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:48.016142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e29f-5dd5-4741-929d-6a1c69fdfd97 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.016739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e29f-5dd5-4741-929d-6a1c69fdfd97 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.017176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3e29f-5dd5-4741-929d-6a1c69fdfd97 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.019508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 135/270] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:48.027916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a223a-3945-41d1-9cd3-a3758d0a99ca None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.028399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a223a-3945-41d1-9cd3-a3758d0a99ca None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.028845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a223a-3945-41d1-9cd3-a3758d0a99ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.050160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9c0a223a-3945-41d1-9cd3-a3758d0a99ca None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:48.052675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9c0a223a-3945-41d1-9cd3-a3758d0a99ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:48.078693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.087270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915687b-6342-4ddd-964f-5b3a615891aa None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.088064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915687b-6342-4ddd-964f-5b3a615891aa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.089033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915687b-6342-4ddd-964f-5b3a615891aa None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.090631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 136/271] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:46:48.096842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.097394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.097882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.122535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:48.123752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:48.159933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 136/272] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:48.162036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776af8-6a00-4721-908a-aff0d29d5890 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.162323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776af8-6a00-4721-908a-aff0d29d5890 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.162594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da776af8-6a00-4721-908a-aff0d29d5890 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.164043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 137/273] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:48.171847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.173927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.174747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.175018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.197984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:48.199435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:48.216671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 137/274] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:48.277808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 138/275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:48.466380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.516974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.584501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995ce3-4365-45e6-9f9b-8f08445eb3af None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:48.620068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.628429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:48.629322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.629596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.629914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.637062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6007-4a99-45fd-b103-a16b79db0ded None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:48.640266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:48.645354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:48.646405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:48.647310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 138/276] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:48.647972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.680006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.681543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:48.682145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.682562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.682676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.694361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:48.699277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:48.700193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:48.701032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 139/277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:48.701707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.766898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ca3f-9531-40a7-9ee1-03a6865b6fb4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:48.804410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:48.805071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.805345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.805612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.806721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:48.807069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51b0ac-c9a9-4b8c-b206-16dc758426da None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:48.808165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:48.810057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 139/278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:48.810832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.847759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:48.848277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.848551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.848846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.849503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:48.849799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:48.851178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:48.859673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 140/279] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:48.860509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.872571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.910237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:48.917262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b93a5-7107-49d6-89fb-809537a8840f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:48.953578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:48.954272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:48.954550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:48.954813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:48.956147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:48.956514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:48.957971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:48.966385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 140/280] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:48.967062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:48.977143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951385d-6e85-483a-af37-b3f687aea55a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.014822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.015685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.015970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.016242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.016969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.018944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.052615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 141/281] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:46:48 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:49.052615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:49.089630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b3bca-7cdd-41b2-8ead-01018db84d15 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.133228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.134071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.134448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.134948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] PATH_INFO: `/v3/users/29fd1ed8031c432d89d49bc189317483` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.138499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:49.154794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] RBAC: Authorizing `identity:get_user(user_id=29fd1ed8031c432d89d49bc189317483)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.156458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.159242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 141/282] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:48 2022] GET /identity/v3/users/29fd1ed8031c432d89d49bc189317483 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:49.168605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:49.191361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:49.193044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a997-8bed-480d-99ff-c65123e061dd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.234396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.235048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.235321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.235587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] PATH_INFO: `/v3/users/04eaff7a0d614ed9be0036019b519b9b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.236832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] RBAC: Authorizing `identity:get_user(user_id=04eaff7a0d614ed9be0036019b519b9b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.238287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.240472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 142/283] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:49 2022] GET /identity/v3/users/04eaff7a0d614ed9be0036019b519b9b => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:49.248814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:49.308973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238e7eb-e14d-4fd3-a866-8c154d1f6087 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.357737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.358337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.358919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.358919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.359594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, user.id=29fd1ed8031c432d89d49bc189317483, scope.system=all) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:49.359922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.361503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.370377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 142/284] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 06:46:49 2022] GET /identity/v3/role_assignments?user.id=29fd1ed8031c432d89d49bc189317483&scope.system=all&role.id=65a7d60481ab48fbb33706644bf422bf => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:49.385601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31041a-506e-439f-b589-a609549fbf27 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.422387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:49.429192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.430209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.430689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.431193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.432706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.434633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db109-b900-4fe7-a7ea-151aef9371fc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.437071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 143/285] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:49 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:49.442790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:49.550951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:49.577071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4065a8-882c-4894-b51d-fc8c50a9d9e5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:49.614936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:49.615605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.615881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.616147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/users/04eaff7a0d614ed9be0036019b519b9b/roles/9392a2850e27457c9313cd7cc0faf77b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.618154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, user_id=04eaff7a0d614ed9be0036019b519b9b, role_id=9392a2850e27457c9313cd7cc0faf77b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:49.619588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce221b50-07e7-47b3-a83d-cbe58bc19192 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:49.636598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 143/286] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:46:49 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/users/04eaff7a0d614ed9be0036019b519b9b/roles/9392a2850e27457c9313cd7cc0faf77b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:49.639826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba405-2cc6-4caa-9478-ef71e35701db None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.640753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba405-2cc6-4caa-9478-ef71e35701db None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.641223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba405-2cc6-4caa-9478-ef71e35701db None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.642849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 144/287] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:49.649587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:49.649883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:49.650143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:49.675353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:49.676713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:49.771028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:50.111135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba405-2cc6-4caa-9478-ef71e35701db None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:50.232246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba405-2cc6-4caa-9478-ef71e35701db None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:50.281393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:50.281963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:50.282243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:50.282516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:50.294995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:50.300392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:50.301281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:50.302783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:50.309685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:50.430316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:50.472608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335713f2-d743-4bd2-851d-d933282efc4b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:50.512024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:50.512716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:50.512996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:50.513326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:50.514000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:50.514301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:50.515671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:50.524551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 145/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:50.531020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:50.635314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:50.687167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c24b-67e2-4011-a2e6-80d1637cafab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:50.739881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:50.740538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:50.740849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:50.741127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] PATH_INFO: `/v3/users/66266d3974314699a5c01cd9416b9d6a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:50.742307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] RBAC: Authorizing `identity:get_user(user_id=66266d3974314699a5c01cd9416b9d6a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:50.743975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:50.745931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 146/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:50 2022] GET /identity/v3/users/66266d3974314699a5c01cd9416b9d6a => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:50.751324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:50.891446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e044-01d7-47e5-bc48-ead7a153a233 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:50.925714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:50.936261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:50.936932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:50.937439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:50.937905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:51.038476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:51.039959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:51.201867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:46:51.208246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:51.372520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6401ab-25cb-44d2-ae56-bd6d91576bbd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:51.406828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:51.416430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:51.416709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:51.416929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:51.417190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:51.418351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:51.420028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679f96-e965-446f-a174-b2388d8af54a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:51.422037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 147/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:51 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:51.428855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:51.477466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:51.577640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7f859-08b2-4b77-bdfe-b64a97f6deac None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:51.628141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:51.629153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:51.629659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:51.630246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:51.631236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=66266d3974314699a5c01cd9416b9d6a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:51.631740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:51.633425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5d02-5539-470e-bcad-82e8d26009df None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:51.645982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 147/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:51 2022] GET /identity/v3/role_assignments?user.id=66266d3974314699a5c01cd9416b9d6a&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=65a7d60481ab48fbb33706644bf422bf => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:51.942753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3754de-0c7f-492a-a150-b3d87cb5b79a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:51.943293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3754de-0c7f-492a-a150-b3d87cb5b79a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:51.943293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3754de-0c7f-492a-a150-b3d87cb5b79a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:51.944782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 148/295] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:51.950605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18de41-8c56-45b8-a384-76c61bbf69d8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:51.951239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18de41-8c56-45b8-a384-76c61bbf69d8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:51.951699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18de41-8c56-45b8-a384-76c61bbf69d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:51.977004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4e18de41-8c56-45b8-a384-76c61bbf69d8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:51.978574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e18de41-8c56-45b8-a384-76c61bbf69d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:52.057203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 148/296] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:52.090344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f675-653c-474b-b168-0e86f12be8fc None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.090631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f675-653c-474b-b168-0e86f12be8fc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.090910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f675-653c-474b-b168-0e86f12be8fc None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.092332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 149/297] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:52.098220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebeb76-4a59-4047-bab3-11d9dcd8f4f4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.098513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebeb76-4a59-4047-bab3-11d9dcd8f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.098762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebeb76-4a59-4047-bab3-11d9dcd8f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.125608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a5ebeb76-4a59-4047-bab3-11d9dcd8f4f4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:52.126803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a5ebeb76-4a59-4047-bab3-11d9dcd8f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:52.155567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:52.220852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:52.235481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c696a5-2334-4168-9a61-4f24c18a020d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.236060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c696a5-2334-4168-9a61-4f24c18a020d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.236541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c696a5-2334-4168-9a61-4f24c18a020d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.238465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 150/299] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:52.244124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.244407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.244726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.274948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:52.276428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:52.347461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 150/300] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:52.381953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c696a5-2334-4168-9a61-4f24c18a020d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.488803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c696a5-2334-4168-9a61-4f24c18a020d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:52.516082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.523877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:52.524539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.524848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.525119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.536839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:52.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:52.543408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:46:52.544641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 151/301] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:52.549570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.613714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:52.635197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:52.652318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4ac65-28d0-4877-a8c8-026d0133fc65 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:52.666419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f92d2-b9e4-4767-89fb-d13f95abc24e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:52.689563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:52.690332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.690764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.691035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.692386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:52.693881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:52.695825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 151/302] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:52.696702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.704890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:52.706026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.706304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.706571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.707241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:52.707541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:52.709366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:52.724542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 152/303] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:52.725568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.809368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dad82-49c7-475e-99fe-b297a55cca4f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:52.838780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e495-49f9-41f2-850d-015c26cce543 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:52.843745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:52.844379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.844802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.845074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.855667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:52.857398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:52.860774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:52.862352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:52.863249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 152/304] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:52.863899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.878605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:52.879648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:52.880282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.880559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.880877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] PATH_INFO: `/v3/groups` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.881498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:52.882918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa1272-3fbb-48be-92ac-62841599f0b9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:52.898984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 153/305] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 13 06:46:52 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:52.900181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7eff1-0b62-4bc2-a97e-817556b191fb None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:52.900464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7eff1-0b62-4bc2-a97e-817556b191fb None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:52.900770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7eff1-0b62-4bc2-a97e-817556b191fb None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:52.904632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 154/306] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:52.904632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7eff1-0b62-4bc2-a97e-817556b191fb None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:52.981626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d4ce-d053-4a04-afdb-f574eb6ee441 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.021721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.021721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.021721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.022070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] PATH_INFO: `/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.032071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7eff1-0b62-4bc2-a97e-817556b191fb None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.039721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7c8a4c6bb24d4ebbbe078e3114ff96)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.041298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ac740-9e43-4470-96be-4724cdd446b3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.043221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:53.044245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.044511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.044809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.063276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:53.064382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:53.072302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.072936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.073212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.073478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.074141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:53.074435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.075819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.086054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 155/308] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:53.086872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.137020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.149046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 154/309] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:53.150231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.152656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.208456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96fc4-4f1a-42ff-9081-a8623f9d5e91 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.244510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.245591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.246058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.246514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.247438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, user.id=2c7c8a4c6bb24d4ebbbe078e3114ff96, scope.system=all) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:53.248015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.249764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.256350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 156/310] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/role_assignments?user.id=2c7c8a4c6bb24d4ebbbe078e3114ff96&scope.system=all&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:53.258059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac3e6b-9c75-4b4f-b35a-f7841fea31e8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.297553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.298207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.298479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.298745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] PATH_INFO: `/v3/users/29fd1ed8031c432d89d49bc189317483` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.300385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] RBAC: Authorizing `identity:get_user(user_id=29fd1ed8031c432d89d49bc189317483)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.301899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.304074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 155/311] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/users/29fd1ed8031c432d89d49bc189317483 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:53.309588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.423824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94782e9f-41a3-47ee-8576-002eeeff71bd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.428813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.449105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.463371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.464354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.464852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.465356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] PATH_INFO: `/v3/system/users/29fd1ed8031c432d89d49bc189317483/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.466977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29fd1ed8031c432d89d49bc189317483, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.468564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.480957 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 157/312] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 13 06:46:53 2022] PUT /identity/v3/system/users/29fd1ed8031c432d89d49bc189317483/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:53.535909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.574244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da49d-5e39-4e96-afaa-fbfae6b6815c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.615997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.616689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.617030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.617301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.629856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:53.634803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:53.635731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:53.636534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 156/313] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:53.642281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.762483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa6f46-4393-49ba-b219-e96c95dcf85d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.797694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.798310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.798590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.798860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.799597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:53.799902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.801319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.810247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 158/314] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:53.816392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:53.927554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35bf4d-6f69-4978-8a76-677b0b64ed63 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:53.958834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:53.965813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:53.966452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:53.966733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:53.967004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] PATH_INFO: `/v3/users/04eaff7a0d614ed9be0036019b519b9b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:53.968146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] RBAC: Authorizing `identity:get_user(user_id=04eaff7a0d614ed9be0036019b519b9b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:53.969615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:53.972091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 157/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/users/04eaff7a0d614ed9be0036019b519b9b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:53.977495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:54.009306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:54.088967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0694da3-8e48-4509-81c9-1fe4ac03d218 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:54.123408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:54.124020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:54.124302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:54.124592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:54.195746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:54.197320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:54.229548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:54.301850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:46:54.307249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:54.418741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768325c-a648-4212-9747-6dd3d37bcf84 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:54.456750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:54.457776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:54.458251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:54.458714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:54.460297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:54.462331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437748e-612f-4ecc-a427-17122a2a59c6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:54.464683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 158/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:46:54 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:54.470605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:54.573353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2d7b-4d56-472b-b4c2-8cb213bf85fb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:54.602837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:54.612905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:54.613781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:54.614248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:54.614704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:54.615613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, scope.project.id=255922e8a87742c39ee5deb818695d79, user.id=04eaff7a0d614ed9be0036019b519b9b) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:54.616201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:54.617924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d31a3-0710-4305-a670-e23f64224c15 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:54.624674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 160/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:46:54 2022] GET /identity/v3/role_assignments?user.id=04eaff7a0d614ed9be0036019b519b9b&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:55.241727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000165f7-0210-49f4-832a-d38391168da3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.242232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000165f7-0210-49f4-832a-d38391168da3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.242336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000165f7-0210-49f4-832a-d38391168da3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.243631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 159/319] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:55.248809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95491f8-454c-41cc-9fed-0602ce86fc1a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.249195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95491f8-454c-41cc-9fed-0602ce86fc1a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.249369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95491f8-454c-41cc-9fed-0602ce86fc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.268800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b95491f8-454c-41cc-9fed-0602ce86fc1a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:55.270005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b95491f8-454c-41cc-9fed-0602ce86fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:55.335751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:55.501316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e0bc-f5f9-4b3d-91f5-dbb9028bb834 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.501673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e0bc-f5f9-4b3d-91f5-dbb9028bb834 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.501872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1e0bc-f5f9-4b3d-91f5-dbb9028bb834 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.503875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 160/321] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:55.508842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.509128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.509398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.527868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:55.529064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:55.594253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 162/322] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:55.609630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e0bc-f5f9-4b3d-91f5-dbb9028bb834 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:55.682245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:55.724220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1e0bc-f5f9-4b3d-91f5-dbb9028bb834 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:55.758548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:55.759176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.759455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.759722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.760839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:55.762307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9327606-d6a5-47b9-90bc-ef3147d02259 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:55.764039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 161/323] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:55.770235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:55.793145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e7a6-3a1f-48e4-9691-5575824a8c1f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.793426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e7a6-3a1f-48e4-9691-5575824a8c1f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.793693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e7a6-3a1f-48e4-9691-5575824a8c1f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.795059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 162/324] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:46:55.801103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.801387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.801714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.820708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:55.822060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:55.827898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:55.874880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312adbce-f467-4809-af69-0f37b84490d5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:55.888616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 163/325] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:55.889536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:55.914079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:55.914990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:55.915449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:55.915779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] PATH_INFO: `/v3/groups` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:55.916409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:55.918067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:55.943167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 163/326] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 13 06:46:55 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:46:55.963446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.007578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dc72e-1f4a-43c4-a832-805d63fcdcfc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.052816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.053518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.053866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.054140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.067250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:56.072340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:56.073271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:56.074066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 164/327] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:56.081649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.170757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.193047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77de176-8259-4e46-9781-a33f7bf44218 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.210175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.242954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.244047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.244550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.245134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.245999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:56.246408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.247961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.257630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 164/328] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:56.263346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.295257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa995-ace4-4043-a068-a913266eb2ed None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.323376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.338343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.339307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.339723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.340154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.352978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:56.358922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:56.359979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:56.360795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:56.363074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 165/329] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:46:56.369091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.397409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f293-fb9a-44c5-9abe-af17736e2a20 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.450103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.451068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.451544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.452029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] PATH_INFO: `/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.453413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7c8a4c6bb24d4ebbbe078e3114ff96)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.455056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.457584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 165/330] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:56.464723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.500069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a77a-2cbe-4cde-94fd-ff2db7d2479a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.525005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.540731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.541349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.541630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.541897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.542609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:56.542864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.544242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.557766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 166/331] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:56.563187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.614541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d4d68-df0a-4a40-80cd-603495d08964 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.624974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.661822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.662479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.662752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.663020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] PATH_INFO: `/v3/system/users/2c7c8a4c6bb24d4ebbbe078e3114ff96/roles/9392a2850e27457c9313cd7cc0faf77b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.664539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2c7c8a4c6bb24d4ebbbe078e3114ff96, role_id=9392a2850e27457c9313cd7cc0faf77b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.665951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.676718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 166/332] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 13 06:46:56 2022] PUT /identity/v3/system/users/2c7c8a4c6bb24d4ebbbe078e3114ff96/roles/9392a2850e27457c9313cd7cc0faf77b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:46:56.700896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049bcb5-9040-4da0-b887-120041781ed2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.742277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.742992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.743275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.743544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] PATH_INFO: `/v3/users/29fd1ed8031c432d89d49bc189317483` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.744961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=29fd1ed8031c432d89d49bc189317483)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.746571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266e128-e3d7-4260-94b2-07377d93f3e4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.748434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/users/29fd1ed8031c432d89d49bc189317483 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:46:56.754771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:56.879591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9251e5-4017-4b34-ae2e-2441dc752337 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:56.889235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:56.919005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:56.919675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:56.919950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:56.920219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:56.921046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] RBAC: Adding query filter params (role.id=65a7d60481ab48fbb33706644bf422bf, user.id=29fd1ed8031c432d89d49bc189317483, scope.system=all) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:56.921355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:56.922853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b86aa-27f5-4193-9e79-d1e2d0aeb798 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:56.936480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 167/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 06:46:56 2022] GET /identity/v3/role_assignments?user.id=29fd1ed8031c432d89d49bc189317483&scope.system=all&role.id=65a7d60481ab48fbb33706644bf422bf => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:58.454005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f026-5812-47e3-b23f-a88ec59ae962 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:58.454928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f026-5812-47e3-b23f-a88ec59ae962 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:58.455559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f026-5812-47e3-b23f-a88ec59ae962 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:58.457744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 168/335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:58.463623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:58.464495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:58.464995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:58.490267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:58.491793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:58.568627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 168/336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:46:59.146294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511f026-5812-47e3-b23f-a88ec59ae962 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:59.299642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511f026-5812-47e3-b23f-a88ec59ae962 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:59.321621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:59.347747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:59.348792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.349302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.349833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.363844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-dd3ce3bc-0687-422b-a7d7-38e664137d95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:46:59.369195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:46:59.370158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:46:59.370960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:46:59.373617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 169/337] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:46:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:46:59.379927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:59.493208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:59.505279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91124-6566-4810-a4ca-13ca16e8f53e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:59.520117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbc22-f3d1-407f-879d-fba5dc7a1beb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.520640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbc22-f3d1-407f-879d-fba5dc7a1beb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.520746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccbc22-f3d1-407f-879d-fba5dc7a1beb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.522239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 170/338] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:59.527412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.527687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.527952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.556566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:59.559460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:59.575997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:59.576950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.577437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.577882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.578839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:46:59.579317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:59.581791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e27c96-6cf7-4dcc-9d0e-81b487541082 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:59.591574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:46:59.593060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92cf60-6447-4084-aaa2-f8d53a20c742 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.593539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92cf60-6447-4084-aaa2-f8d53a20c742 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.594059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92cf60-6447-4084-aaa2-f8d53a20c742 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.600856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 170/340] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:46:59.603177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0534-b009-4534-8f37-a134e572557a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.603668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0534-b009-4534-8f37-a134e572557a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.604230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0534-b009-4534-8f37-a134e572557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.628174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-619a0534-b009-4534-8f37-a134e572557a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:59.633606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-619a0534-b009-4534-8f37-a134e572557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:59.685867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 171/341] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:59.687621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:59.764171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 171/342] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:46:59.834495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ccb5-821d-4033-92e6-8d2f7d03f44e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:59.837227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:59.880814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:59.881754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:59.882209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:59.882655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:59.959464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:59.961403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:00.000874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3bbf-fe8f-49ff-b1ce-d674bcc81a41 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.001435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3bbf-fe8f-49ff-b1ce-d674bcc81a41 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.001883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a3bbf-fe8f-49ff-b1ce-d674bcc81a41 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.003925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 172/343] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:00.014389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.014669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.014947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.057123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:00.058341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:00.097149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 172/344] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:00.098992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.120533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.182851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 173/345] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:00.233837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36acba7-8bcb-46e4-8004-30c7ca5c3958 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.257020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.274307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.274944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.275228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.275591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.276763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:00.278472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:00.284999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 173/346] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:00.293939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.295358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.375917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.400013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd8dc-98ed-4486-9303-c99a71d3800a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.412087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22651fce-1990-46a1-9960-3908709cd8fb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.437335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.438325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.438805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.439273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.450564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.451075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:00.451571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.451995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.452406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:00.457782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:00.458661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:00.459481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:00.462164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 174/347] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:00.462430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:00.463455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.464143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:00.474931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 174/348] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:00.476159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.585095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.616282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60906c-350b-4e0b-9b1b-1e1f5c52380a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.635410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c4403-6f0f-4ae1-aba4-909aade39aef None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.657839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.659123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.659562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.659968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.673799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:00.677993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.679007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.679488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.679995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:00.680208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:00.681125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 175/349] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:00.685292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.687319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:00.687943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:00.690106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:00.694798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.704094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 175/350] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:00.706149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.826095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092f6b-e60c-41d8-8387-026e18211077 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.845633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0996-38a9-49e6-aa51-00e5b291660a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:00.872485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.873515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.873997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.874274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.875015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=a19ff4e3b7d44dd385893859386e8995) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:00.875329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:00.876798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:00.882952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=65a7d60481ab48fbb33706644bf422bf => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:00.886180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:00.888841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:00.899262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:00.900358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:00.900903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:00.901371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:00.915620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:00.921607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:00.922567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:00.923379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:00.926747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:00.928128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.007846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.014420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf335b6e-34ee-46f4-a9bf-6dbb46208576 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.058242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3760ac-60e1-4f00-a6b9-dc96b9f95cbc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.060112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.060870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.061244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.061608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.062693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:01.062693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.064250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca22a-e92a-43d4-90f2-954408f82ce3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.074234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 177/353] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.075762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1fb8-b1e9-4162-abc5-deba5a800b9f None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.076146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1fb8-b1e9-4162-abc5-deba5a800b9f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.076512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1fb8-b1e9-4162-abc5-deba5a800b9f None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.078096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 178/354] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:01.079106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1fb8-b1e9-4162-abc5-deba5a800b9f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.109144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.110151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.110610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.111049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.149776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.191236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.192207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1fb8-b1e9-4162-abc5-deba5a800b9f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.193404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc890f3-406e-45f6-b625-e0b06f5a1b99 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.229175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.229843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.230184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.230564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.231296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:01.231662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.233305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.245340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 179/355] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.245506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.273208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.325217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 177/356] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:01.327675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.328396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.329111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.353501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:01.355744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:01.368180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746d2d-cf5d-4cb4-9466-90804ab6efe6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.397551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.412740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.413370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.413648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.413919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] PATH_INFO: `/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.415284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] RBAC: Authorizing `identity:get_user(user_id=2c7c8a4c6bb24d4ebbbe078e3114ff96)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.416949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.423648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 180/357] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/users/2c7c8a4c6bb24d4ebbbe078e3114ff96 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.424670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.441858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 178/358] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:01.443057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.536061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.546846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eda50-e82b-418c-8fde-8858d1885f0f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.550301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba112c74-fead-4c44-b3f7-7f12ceeac738 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.585724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.587024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.587543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.588007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.588205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.588671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.588946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.589216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.590366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.591847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.593829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 179/359] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.594395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.661309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.674553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.678266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10b63d-2d6a-48da-9e07-2ab034201e44 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.710555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783963-5790-4368-8a3c-c9824f7b4eec None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.746973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.747564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.747836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.748102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.748866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] RBAC: Adding query filter params (role.id=9392a2850e27457c9313cd7cc0faf77b, user.id=2c7c8a4c6bb24d4ebbbe078e3114ff96, scope.system=all) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:01.749169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.750598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4324c7-2129-4802-9495-916bb75d4d71 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.763570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/role_assignments?user.id=2c7c8a4c6bb24d4ebbbe078e3114ff96&scope.system=all&role.id=9392a2850e27457c9313cd7cc0faf77b => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.764896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069be4d3-b941-441c-8a2c-20e469069eba None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.765193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069be4d3-b941-441c-8a2c-20e469069eba None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.765442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069be4d3-b941-441c-8a2c-20e469069eba None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.766664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 181/361] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:01.772954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069be4d3-b941-441c-8a2c-20e469069eba None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.790668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.803453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 181/362] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:01.805441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.806016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.806492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.828894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:01.831172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:01.895419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069be4d3-b941-441c-8a2c-20e469069eba None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:01.915850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 182/363] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:01.917274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:01.945853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:01.946421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:01.946694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:01.946970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:01.948095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:01.957852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:01.960375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 182/364] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:01.960491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:01.960607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.034632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98f97-b528-4566-9bd3-63b2d905ce32 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.082075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.083012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.083297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.083571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.101143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.102151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:02.108457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:02.109520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:02.110309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:02.113748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 183/365] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:02.115028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.125520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21107e-c917-4752-8c50-57d5b467cf97 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.171611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.172328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.172726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.173130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.174369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.176133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.179804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 183/366] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:01 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:02.180129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.226084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.245051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ac75b-a91f-4eda-9ae8-6d7f87df049d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.295111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.296081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.296554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.297747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.299613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=a19ff4e3b7d44dd385893859386e8995) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:02.300280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.302434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.309721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 184/367] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:02.310632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b9b5b-8542-4c63-bf39-3f566f0b0bd9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.311045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.362263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.362263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.362569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.362998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.363693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:02.364000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.365456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.374621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 184/368] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:02.376704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.393889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.448521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee120f-85aa-45c7-9145-eb4165722bb2 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.493318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.494350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.494827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.495322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.496819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.497445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880e0-52fc-4768-8e18-fe8ddeb84efa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.498798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.502200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:02.503476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.527259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.539750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.540352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.542782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.543079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.555354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:02.560856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:02.561729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:02.562507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 185/370] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:02.563175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.643364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9ce6-77cb-4aaa-996f-fa44b13007e5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.656436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.697685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c351bb-f398-4712-bed6-2778d1ff2aee None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:02.697872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.698447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.698728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.699258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.750467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:02.751298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:02.751635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:02.752891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:02.756686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=255922e8a87742c39ee5deb818695d79) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:02.757124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.758777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.765909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 186/371] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=65a7d60481ab48fbb33706644bf422bf => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:02.767234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:02.833348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:02.834937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:02.862744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:02.928621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec737a9-c47e-471e-9b13-b685554b225f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.017800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.022043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.022043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.022043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.022756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:03.023067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.025956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.039257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.051077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 186/372] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:03.056062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 187/373] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:03.057320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.061604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.170403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3475ac-8a51-4a58-96fe-03de076e85f2 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.189902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.214862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.215888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.216357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.216859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.218294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.219914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.222410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 187/374] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:03.228115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.289553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25948b4c-1031-401c-b588-a8023569aef4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.373178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.374168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.374656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.375119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.435377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291b323-163c-4ed5-ad3f-0ce3f9701a29 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.476155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.477169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.477682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.478151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.479577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.481246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.484045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:03.490618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.524052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.531326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.532957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296573f-7f62-4fad-8d1b-26ba1d4ec020 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.564335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.625173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81770e9-78ac-4731-ac9d-9c609f30b48a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.658735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 188/376] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:03.658735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ab4f-e154-4660-b946-fac85cda708c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.658735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ab4f-e154-4660-b946-fac85cda708c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.659237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8ab4f-e154-4660-b946-fac85cda708c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.661450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 189/377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:03.666092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8ab4f-e154-4660-b946-fac85cda708c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.673307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.674676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.675105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.675613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.676506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=255922e8a87742c39ee5deb818695d79) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:03.677236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.678932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3c39a-2a96-495b-b89d-eeba6cd9630d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.687438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 189/378] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:03.689073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.690159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.690631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.713889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:03.715455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:03.809837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.812675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 190/379] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:03.814732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8ab4f-e154-4660-b946-fac85cda708c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:03.852013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:03.853016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:03.853734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:03.854162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] PATH_INFO: `/v3/projects/7293e66323e0459699b8f04045409629` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:03.855425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] RBAC: Authorizing `identity:get_project(project_id=7293e66323e0459699b8f04045409629)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:03.857052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:03.859204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 190/380] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/projects/7293e66323e0459699b8f04045409629 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:03.864987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:03.924948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:03.989103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b2feb-d8b0-4824-8212-d901426fba90 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.055015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.055891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.056327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.056780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] PATH_INFO: `/v3/groups/dfeed918ec764f1e9d83f7c40944ce80` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.064075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] RBAC: Authorizing `identity:get_group(group_id=dfeed918ec764f1e9d83f7c40944ce80)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:04.065915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:04.068113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 191/381] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:03 2022] GET /identity/v3/groups/dfeed918ec764f1e9d83f7c40944ce80 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:04.073713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.156561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.198622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898e817-ccdb-4808-9fef-fbe3d76a8a8a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.238249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.239094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.239528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.239941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.240838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] RBAC: Adding query filter params (group.id=dfeed918ec764f1e9d83f7c40944ce80, role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=7293e66323e0459699b8f04045409629) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:04.241293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:04.242968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:04.249020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 191/382] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:04 2022] GET /identity/v3/role_assignments?group.id=dfeed918ec764f1e9d83f7c40944ce80&scope.project.id=7293e66323e0459699b8f04045409629&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:04.277630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d24db-3036-48fa-88ff-0cf3492836ea None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.291212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:04.323930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.324906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.325340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.325768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.342079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:04.348404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:04.349593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:04.350629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:04.352926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 192/383] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:04.358812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.417122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:04.502473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876227-ff92-45a8-86af-ce09c44a74c5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.551810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.552949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.553389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.553801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.554613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:04.555048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:04.556557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:04.565639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 192/384] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:04.571472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.678007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6c84c-65e7-4aea-b8db-191c1beb2b70 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.715936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.716838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.717280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.717700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.718939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:04.720509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:04.722627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 193/385] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:04 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:04.728228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.862567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0720d-4374-4b50-955c-8aec6f7aa308 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:04.864883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:04.905292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:04.905936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:04.906209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:04.906475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:04.907643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:04.909632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bfe1f-b340-4358-b9ea-c1b338b1b609 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:04.911270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 193/386] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:04 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:04.917043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:04.989010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:05.059127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcc29d-c4ed-400e-ad81-cfeae8593d70 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:05.104118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:05.104883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:05.105167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:05.105482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/groups/5be948373c7b46d8ac427113a3a64672/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:05.110089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, group_id=5be948373c7b46d8ac427113a3a64672, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:05.111679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08440721-03d0-4b06-a06c-675d49e01c6f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:05.140943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 194/387] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 06:47:04 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/groups/5be948373c7b46d8ac427113a3a64672/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:05.337779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6cc0-5849-4e57-a845-577973e1460f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:05.338414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6cc0-5849-4e57-a845-577973e1460f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:05.338896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6cc0-5849-4e57-a845-577973e1460f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:05.340722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 194/388] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:05.350536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d405d6-3d46-4eef-bd91-7b0be4da8be6 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:05.350849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d405d6-3d46-4eef-bd91-7b0be4da8be6 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:05.351098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d405d6-3d46-4eef-bd91-7b0be4da8be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:05.371064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-50d405d6-3d46-4eef-bd91-7b0be4da8be6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:05.372397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-50d405d6-3d46-4eef-bd91-7b0be4da8be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:05.462962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 195/389] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:05.509394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5ac-b822-4ddf-a551-90efa6c67d5d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:05.509727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5ac-b822-4ddf-a551-90efa6c67d5d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:05.509951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771a5ac-b822-4ddf-a551-90efa6c67d5d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:05.511420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 195/390] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:05.516796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:05.517325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:05.518364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:05.537206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:05.538903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:05.569112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:05.626402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 196/391] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:05.848546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771a5ac-b822-4ddf-a551-90efa6c67d5d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:05.932672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.032203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771a5ac-b822-4ddf-a551-90efa6c67d5d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.098970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.099623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.099905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.100177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.107643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d78d-4faf-45ed-a0fb-307ac1633c0b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.122096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:06.128091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:06.129406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:06.130247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:06.132767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:06.136745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.159818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.160457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.160760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.161024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.174608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:06.175500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:06.181777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:06.182798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:06.183602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:06.192414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.218377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:06.316201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3261-3d52-45ac-b68c-5a0b80333ae4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.357285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.357891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.358419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.358696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.359362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:06.359659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.361956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.371039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 198/394] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:06.377278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.414521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925cef0-2d59-4779-bf8c-51a8ca4f2390 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.472819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:06.494696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f9b5-1026-418d-877a-369f5c9d0b10 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.515611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.516255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.516618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.516999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.517534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:06.517908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.519370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.533087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.534462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.534969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.535384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.536685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.538576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.540678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 199/395] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:06.544709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 197/396] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:06.546484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.550049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.668314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baa927-7c8b-4d5f-abcc-71dd522ded1c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.712870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.713974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.714393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.714803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.716078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.717824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.719674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 200/397] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:06.726998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.761010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:06.789121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:06.823452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442f78-3d0b-4ba9-8eb2-0b9a725bc4a5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.856021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9b3d-ac68-4a3a-b816-f8005f619664 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:06.865400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.866041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.866319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.866593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.868035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.869258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109cd23-3917-47bc-823a-343e38685255 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.871795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 198/398] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:06.873035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164130f-89eb-435c-b5b2-7a4c53bb5dd5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.873591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164130f-89eb-435c-b5b2-7a4c53bb5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.873591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164130f-89eb-435c-b5b2-7a4c53bb5dd5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.879730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 199/399] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:06.880659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164130f-89eb-435c-b5b2-7a4c53bb5dd5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:06.897924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:06.898854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.899728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.900238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/groups/5be948373c7b46d8ac427113a3a64672/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.903005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, group_id=5be948373c7b46d8ac427113a3a64672, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:06.905361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32d8c-08cc-4566-aaad-3a070e75b745 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:06.925430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 201/400] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 06:47:06 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/groups/5be948373c7b46d8ac427113a3a64672/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:47:06.931209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:06.931702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:06.932118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:06.965353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:06.967888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:07.066237 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 202/401] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:07.127431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164130f-89eb-435c-b5b2-7a4c53bb5dd5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:07.175734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:07.176399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.176702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.177219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.181311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:07.183205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2586a18-fe05-496f-a05a-cff34afa3a3a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:07.185486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 200/402] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:06 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:07.191648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:07.203014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560221b-b3cb-477f-8786-b263f9d82ef7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.203175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:07.203262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560221b-b3cb-477f-8786-b263f9d82ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.203262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560221b-b3cb-477f-8786-b263f9d82ef7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.204885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 201/403] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:07.209758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.210037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.210308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.230671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:07.231863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:07.246957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:07.345031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 202/404] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:07.347347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c2ad8-dc77-4836-b61d-dda731875e70 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:07.382920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:07.383854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.384265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.384683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995/groups/5be948373c7b46d8ac427113a3a64672/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.387617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=a19ff4e3b7d44dd385893859386e8995, group_id=5be948373c7b46d8ac427113a3a64672, role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:07.389179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:07.407043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 203/405] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 06:47:07 2022] PUT /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995/groups/5be948373c7b46d8ac427113a3a64672/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:07.494247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:07.626230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938ebc-bc4b-4101-8433-9afb81e0abca None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:07.670788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:07.671431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.672840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.672840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.684620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:07.690138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:07.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:07.692353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:07.693932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 203/406] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:07.699642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:07.757562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:07.774279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:07.778604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:07.845324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ab305-e6f5-450a-828b-46380acf8d30 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:07.913616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:07.914152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:07.914426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:07.914694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:07.915366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:07.915662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:07.917059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:07.933812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 204/407] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:07.940215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:07.955675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a9318-28db-4106-978e-3b5268f2f1b7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:07.996839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.000790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.001107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.001329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.045359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:08.051436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:08.052623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:08.053450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:08.055937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 204/408] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:08.064869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.131633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6fe50-5e36-4fff-b3f9-c865dc401cd8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.174443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:08.187031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.187664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.187939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.188206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.190319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.191902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:08.193962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7db80-4a49-494a-951d-427a75d2c796 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.197051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 205/409] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:07 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:08.198238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2b6b-be76-4e4f-9a12-fe6da3d8b74c None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.198516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2b6b-be76-4e4f-9a12-fe6da3d8b74c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.198782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2b6b-be76-4e4f-9a12-fe6da3d8b74c None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.200234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 206/410] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:08.202063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2b6b-be76-4e4f-9a12-fe6da3d8b74c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.233203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158102a8-2425-4402-b43c-818e6f9e5e32 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.274843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.275449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.275770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.276186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.276977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:08.277396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.278930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c3cf8-3b3f-49b0-a4d8-6da06312cd1c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.288543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 205/411] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:08.289931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.290215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.290487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.310463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:08.311759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:08.335812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2b6b-be76-4e4f-9a12-fe6da3d8b74c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.379668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261d084-84db-45e7-8088-90911c67036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.380621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d084-84db-45e7-8088-90911c67036b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.381101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d084-84db-45e7-8088-90911c67036b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.381378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d084-84db-45e7-8088-90911c67036b None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.382984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261d084-84db-45e7-8088-90911c67036b None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.385101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261d084-84db-45e7-8088-90911c67036b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.387676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:08 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:08.388691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261d084-84db-45e7-8088-90911c67036b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.404747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 206/413] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:08.405919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.458289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:08.503090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261d084-84db-45e7-8088-90911c67036b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.533639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:08.541921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.542619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.542908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.543159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] PATH_INFO: `/v3/groups/dfeed918ec764f1e9d83f7c40944ce80` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.544704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] RBAC: Authorizing `identity:get_group(group_id=dfeed918ec764f1e9d83f7c40944ce80)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.546432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.548208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 208/414] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:08 2022] GET /identity/v3/groups/dfeed918ec764f1e9d83f7c40944ce80 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:08.555470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.626904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d16cf0-2b17-4323-a833-747498f7dfa9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.670738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a020-dbbf-421e-ab52-f32b9250679f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.704440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:08.706191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.706924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.707207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.707475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79/groups/5be948373c7b46d8ac427113a3a64672/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.710073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.710643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.710917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.711216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] PATH_INFO: `/v3/projects/7293e66323e0459699b8f04045409629` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.712342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] RBAC: Authorizing `identity:get_project(project_id=7293e66323e0459699b8f04045409629)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.713089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] RBAC: Authorizing `identity:create_grant(project_id=255922e8a87742c39ee5deb818695d79, group_id=5be948373c7b46d8ac427113a3a64672, role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.713825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.714602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.716483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 209/415] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:08 2022] GET /identity/v3/projects/7293e66323e0459699b8f04045409629 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:08.723006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.751494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 207/416] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 06:47:08 2022] PUT /identity/v3/projects/255922e8a87742c39ee5deb818695d79/groups/5be948373c7b46d8ac427113a3a64672/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:08.811209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:08.836380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80ae0a-da10-4f8d-a4ef-47aac6c5c736 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:08.881214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:08.881898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:08.882175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:08.882444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] PATH_INFO: `/v3/projects/7293e66323e0459699b8f04045409629/groups/dfeed918ec764f1e9d83f7c40944ce80/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:08.886626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] RBAC: Authorizing `identity:create_grant(project_id=7293e66323e0459699b8f04045409629, group_id=dfeed918ec764f1e9d83f7c40944ce80, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:08.888080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:08.916538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 210/417] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 06:47:08 2022] PUT /identity/v3/projects/7293e66323e0459699b8f04045409629/groups/dfeed918ec764f1e9d83f7c40944ce80/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:47:08.991670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5075-cd37-4244-beff-9ee32fdba49f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:09.036953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:09.045478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:09.046158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.046830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.047106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.061887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:09.067596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:09.068538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:09.069381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 208/418] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:09.076258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:09.157485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:09.203694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2139cf5-454f-4740-9a9a-256c8d4e875c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:09.241474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:09.242147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.242427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.242705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.243375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:09.243677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:09.245080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:09.254365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 211/419] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:09.261048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:09.369213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf883b8-5869-47d5-95a4-10a4db9aafd7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:09.419923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:09.420561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.420862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.421134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.490791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:09.511575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:09.512984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dc927-0d8e-44b8-a688-a134dd72466d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:09.634161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 209/420] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:09.639536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:09.648929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414ff9-8152-4446-a217-08b38c4ba284 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.649213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414ff9-8152-4446-a217-08b38c4ba284 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.649490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414ff9-8152-4446-a217-08b38c4ba284 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.651140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 210/421] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:09.656348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.656668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.656944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.691863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:09.693092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:09.762302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730612c0-0565-4693-84ff-a7cace37bed8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:09.788660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:09.817368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:09.818405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:09.818885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:09.819352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:09.821857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:09.823561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:09.827936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 212/422] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:09 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:09.828363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 211/423] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:09.837298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:09.966475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a81ba-7870-47f8-ae17-e915bb3e2dd6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.005393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.006030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.006311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.006586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.007726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:10.009207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:10.011120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 213/424] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:09 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:10.017740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:10.038096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.146458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef558-5733-4719-b45b-f4470fbf9234 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.175761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:10.210279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.211256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.211723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.212206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.213152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=a19ff4e3b7d44dd385893859386e8995) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:10.213650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:10.215262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fb8f-5589-45b0-a71c-0f0fb590fb80 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:10.222229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 212/425] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:10 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=65a7d60481ab48fbb33706644bf422bf => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:10.246022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6520-b8e2-472e-960a-1a2437f60348 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.246631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6520-b8e2-472e-960a-1a2437f60348 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.247132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6520-b8e2-472e-960a-1a2437f60348 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.249183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 213/426] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:10.258428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.258748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.258958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.270010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.297158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:10.298345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:10.363215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbfe20-6084-4ef6-abc9-85614c26c0cb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.402687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.403364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.403644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.403918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.418405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 214/427] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:10.418700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:10.424231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:10.425157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:10.426607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 214/428] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:10.431382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:10.441732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.557899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc069e-d000-4750-8702-3afc6ab7896f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.603688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.604305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.604620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.604902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.605567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:10.605868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:10.607236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:10.617060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 215/429] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:47:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:10.622714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:10.741625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2123-d9fe-493e-b8bf-ebdcd27893de None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.760241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.777755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:10.779954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.780596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.780907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.781184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:10.873922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:10.884336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:10.886124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:10.928561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0351ec-f166-4ff1-ba7d-1f437a035eb8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:10.980713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:10.981362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:10.983598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:10.983598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.001141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:11.008507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:11.009560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:11.010371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 216/430] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:11.016261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.035315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 215/431] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:11.041767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.067055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.156250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f394-d2a8-4b23-80d8-2c9bd93e8949 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.179068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86b62a-f34d-43ae-91f1-eefdce3f3507 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.188175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.202650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.203587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.204076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.204533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.206116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:11.207158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.209060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.220513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 217/432] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:11.226669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.227144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.227330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.227597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.227875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.229045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.230498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.233175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 216/433] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:11.243560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.341301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.357910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755df6c-35e6-4cf3-bbbf-b50c00843b4d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.360775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3fe1-eb3f-4418-87b1-c8ef4f3fc65c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.399840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.400054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.400767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.401043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.401167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.401447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.401782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.402307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.402777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.404294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.411193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 217/434] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:11.412079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.462639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.478082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.479560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.519807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5ba2f-60da-4b10-9d7b-4c5352201f9a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.559632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.560249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.560527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.560827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.561569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=65a7d60481ab48fbb33706644bf422bf, scope.project.id=255922e8a87742c39ee5deb818695d79) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:11.561876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.563319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96601bb5-73f2-4c85-8349-34d73316dd72 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.569978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 218/435] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=65a7d60481ab48fbb33706644bf422bf => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:11.571160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432555a1-9ccb-4abc-b178-17008e0d6c06 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.571442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432555a1-9ccb-4abc-b178-17008e0d6c06 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.571711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432555a1-9ccb-4abc-b178-17008e0d6c06 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.576616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 219/436] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:11.578680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30df42-05c8-48c9-b64a-e862a16d0f2f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.578964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30df42-05c8-48c9-b64a-e862a16d0f2f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.579240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30df42-05c8-48c9-b64a-e862a16d0f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.599506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-fa30df42-05c8-48c9-b64a-e862a16d0f2f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:11.600749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fa30df42-05c8-48c9-b64a-e862a16d0f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:11.614498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 218/437] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:11.620041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.622580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 220/438] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1505-b706-47ce-8769-b4197258a417 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1505-b706-47ce-8769-b4197258a417 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1505-b706-47ce-8769-b4197258a417 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 221/439] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.704695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.705465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.728366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:11.729753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:11.741648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:11.755622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161937-296c-42a5-b17f-fbc18424b83c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.795966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.796641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.796933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.797203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] PATH_INFO: `/v3/projects/a19ff4e3b7d44dd385893859386e8995` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.799419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a19ff4e3b7d44dd385893859386e8995)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.801049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.803751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 219/440] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/projects/a19ff4e3b7d44dd385893859386e8995 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:11.809088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.813408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 222/441] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:11.913157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41126411-c7f7-485b-914e-25114857d7c8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:11.948218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:11.948859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:11.949133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:11.949398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:11.950508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:11.951945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:11.953713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 220/442] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:11.960243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:11.983051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.013353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.054736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.078466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e12c8e-a0c0-4655-8d5b-f124f8e00b33 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.100135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa6a29-1451-4595-a132-36f920d5dad8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.111016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.112213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.112480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.112769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.113485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=a19ff4e3b7d44dd385893859386e8995) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:12.113785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.115193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.120769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=a19ff4e3b7d44dd385893859386e8995&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:12.121532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.138891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.139543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.139816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.140081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.153911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:12.159135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:12.160164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:12.161741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 221/444] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:12.166227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.250269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84068-60f6-4b55-8abf-c0d16c2d3cf5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.273471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.292468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.293158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.293434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.293702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.295219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33afaf0-bfff-4535-9553-7e98c971de86 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.307423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:12.312894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:12.315148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:12.316049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 224/445] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:12.320385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.324708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.342958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.343704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.343941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.344209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.345213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:12.345213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.346910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.355374 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 222/446] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:12.361646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.442092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42057a-5d97-433c-8664-06bdd37020c5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.479984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052496c5-52b1-497a-bd43-41d99db27502 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.486652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.487276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.487547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.487810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.488472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:12.488818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.490201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.502974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 225/447] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:12.508474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.525551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.526187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.526466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.526733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.544674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.579013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.606378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.608104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.623337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899518d-712c-43f4-9dbe-51f2da4310d5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.665599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.666304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.666552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.666756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.713073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 223/448] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:12.718662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.734281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.735738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.763030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.796796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.817650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548805d5-f2d2-4174-845b-22a0227abeac None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.836902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 226/449] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:12.842450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.851422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.852040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.852312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.852611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] PATH_INFO: `/v3/projects/255922e8a87742c39ee5deb818695d79` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.853694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] RBAC: Authorizing `identity:get_project(project_id=255922e8a87742c39ee5deb818695d79)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.855127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.856736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/projects/255922e8a87742c39ee5deb818695d79 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:12.862672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.939657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cc78-9ec2-4c18-84a0-13b373b65a6e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.959814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d44b0-a281-4b7e-a2ae-3a6b492451f4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:12.973913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.974538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.974769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:12.974878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.975075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] PATH_INFO: `/v3/projects/7293e66323e0459699b8f04045409629` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.976200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] RBAC: Authorizing `identity:get_project(project_id=7293e66323e0459699b8f04045409629)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.977819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:12.979444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/projects/7293e66323e0459699b8f04045409629 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:12.984860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:12.995719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:12.996346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:12.996660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:12.996934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] PATH_INFO: `/v3/groups/5be948373c7b46d8ac427113a3a64672` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:12.998041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] RBAC: Authorizing `identity:get_group(group_id=5be948373c7b46d8ac427113a3a64672)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:12.999484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:13.001068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/groups/5be948373c7b46d8ac427113a3a64672 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:13.006826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:13.015084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:13.085462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf6256-43ba-47ea-a53d-020da7115f56 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:13.106309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578927b-d9da-42fb-a7ea-35ebecc5083f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:13.119068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:13.119696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:13.119970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:13.120240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] PATH_INFO: `/v3/groups/dfeed918ec764f1e9d83f7c40944ce80` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:13.121371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] RBAC: Authorizing `identity:get_group(group_id=dfeed918ec764f1e9d83f7c40944ce80)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:13.122818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:13.124518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 06:47:12 2022] GET /identity/v3/groups/dfeed918ec764f1e9d83f7c40944ce80 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:13.130350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:13.140278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:13.140902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:13.141174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:13.141440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:13.142158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] RBAC: Adding query filter params (group.id=5be948373c7b46d8ac427113a3a64672, role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=255922e8a87742c39ee5deb818695d79) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:13.142977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:13.144389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0504ef7-a2a0-4354-9484-5c3dd60b8368 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:13.150031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:13 2022] GET /identity/v3/role_assignments?group.id=5be948373c7b46d8ac427113a3a64672&scope.project.id=255922e8a87742c39ee5deb818695d79&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:13.229327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:13.232259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521268a0-ac28-418e-96a6-d7f05beaa36f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:13.268972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:13.269625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:13.269776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:13.270045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:13.270789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] RBAC: Adding query filter params (group.id=dfeed918ec764f1e9d83f7c40944ce80, role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=7293e66323e0459699b8f04045409629) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:13.271095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:13.272544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c89e3-30b8-413f-8f94-d225a2c4b5ee None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:13.279127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 06:47:13 2022] GET /identity/v3/role_assignments?group.id=dfeed918ec764f1e9d83f7c40944ce80&scope.project.id=7293e66323e0459699b8f04045409629&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:16.203012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9565-0a92-43e0-89dc-0ba5cf210bd3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.203521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9565-0a92-43e0-89dc-0ba5cf210bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.203521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9565-0a92-43e0-89dc-0ba5cf210bd3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.205298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:16.210686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b5cd-44c6-4fb5-b890-66f91b695fcf None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.211130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b5cd-44c6-4fb5-b890-66f91b695fcf None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.211513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965b5cd-44c6-4fb5-b890-66f91b695fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.241571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4965b5cd-44c6-4fb5-b890-66f91b695fcf None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:16.242756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4965b5cd-44c6-4fb5-b890-66f91b695fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:16.278052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334209-4753-484e-a94b-36004d80d95e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.278232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334209-4753-484e-a94b-36004d80d95e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.278498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334209-4753-484e-a94b-36004d80d95e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.279814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 228/457] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:16.286883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796caa-ca8f-4a87-8281-e9e386fa9b54 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.287166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796caa-ca8f-4a87-8281-e9e386fa9b54 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.287438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796caa-ca8f-4a87-8281-e9e386fa9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.318127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-58796caa-ca8f-4a87-8281-e9e386fa9b54 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:16.319331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-58796caa-ca8f-4a87-8281-e9e386fa9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:16.358103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 230/458] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:16.360431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b63d-7d96-463b-91fd-36ab381f9de7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.360886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b63d-7d96-463b-91fd-36ab381f9de7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.361927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b63d-7d96-463b-91fd-36ab381f9de7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.364110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 231/459] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:16.369750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27848-f580-47e7-b70f-e9e0c0b2cf24 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.370507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27848-f580-47e7-b70f-e9e0c0b2cf24 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.370987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27848-f580-47e7-b70f-e9e0c0b2cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.386514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:16.392402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3df27848-f580-47e7-b70f-e9e0c0b2cf24 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:16.393900 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3df27848-f580-47e7-b70f-e9e0c0b2cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:16.418631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 229/460] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:16.490044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 232/461] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:16.576641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cdca-d877-41ce-91dd-5f953adbc0dc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.576931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cdca-d877-41ce-91dd-5f953adbc0dc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.577117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65cdca-d877-41ce-91dd-5f953adbc0dc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.578773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 230/462] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:16.584485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.584798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.585069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.613521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:16.614714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:16.632402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:16.694836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 233/463] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:16.704659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cdca-d877-41ce-91dd-5f953adbc0dc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:16.778353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:16.839357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65cdca-d877-41ce-91dd-5f953adbc0dc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:16.876467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:16.877534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.878035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.878500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.889349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:16.891046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:16.897091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bf21-5895-4342-ba0e-6164d79ca05b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:16.907208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:16.908201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:16.909110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:16.909110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:16.909110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:16.911163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 231/464] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:16.912151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:16.940627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:16.941251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:16.941528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:16.941943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:16.946161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:16.953901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:16.956195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:16.974191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:16.975124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:16.975980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:16.975980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:16.975980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:16.980313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 234/465] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:16.981271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:16.992707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.037067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefca788-4ffd-41ed-932d-8fd22a8f361b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.076415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.077071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.077352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.077624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.089093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.090690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.096818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4768c-6bf6-4e49-9193-8ed1c6f6c6e3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:17.105049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:17.105951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:17.106815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:17.106815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:17.106815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:17.106815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 232/466] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:17.107482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.134591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.135379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.135520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.135757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.136408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:17.136768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.138141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.151756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 235/467] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:17.152686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.200699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.221931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72673043-5a99-484e-ac9c-fb01e29ae811 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.229548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.259420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.260023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.260301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.260590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.261248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:17.261553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.262935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.266655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485c612-84dc-417f-96f7-533a7f009fda None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.280604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 233/468] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:17.281785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.307348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.308021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.308322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.308561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.320246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.321430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:17.337146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:17.338047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:17.339419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:17.339419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:17.339419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:17.339419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 236/469] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:17.339419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.387425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc24b6-b32a-49fc-834a-80b023622803 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.425854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.426463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.426738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.427542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.428181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:17.428481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.429885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.444527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.449467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d2fbe-849d-4488-8f26-2881c46dd58a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.452824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 234/470] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:17.453716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.470695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.490775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.491382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.491769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.492082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.492570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.494044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.518136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 237/471] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:17 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:17.518933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.578827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455acdb-6019-4a57-9f80-092e54964595 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.617622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.618631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.619009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.619289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.619950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.621459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.644899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 235/472] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:17 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:17.645779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.666804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25c247-2e6c-4d26-857b-f0ddc97cafe9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.716473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.717028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.717358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.718108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.718785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:17.719146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.722230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f5407-f4df-48f5-8393-99034e993b5c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.728096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.744367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 238/473] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:17.745271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b5439-99fb-424f-a901-ad1ad5ed0a2b None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.745556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b5439-99fb-424f-a901-ad1ad5ed0a2b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.746336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b5439-99fb-424f-a901-ad1ad5ed0a2b None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.747380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 239/474] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:17.748884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b5439-99fb-424f-a901-ad1ad5ed0a2b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:17.780120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70146180-8819-48bc-b5e9-ad084c612fcc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.794386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:17.826064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.826730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.826972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.827245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.827901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.831334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73bb8-eb79-4f46-beb1-99d1a31a0c1e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.855201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 236/475] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:17 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:17.857397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.857687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.857956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.882916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:17.884255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:17.885913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b5439-99fb-424f-a901-ad1ad5ed0a2b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:17.940703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:17.940703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:17.940703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:17.940703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:17.941079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:17.942586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:17.974653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 240/476] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:17 2022] POST /identity/v3/users => generated 249 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:47:17.990839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 237/477] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:18.296859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:18.415579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:18.426155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332df58d-edef-4eb6-a716-0a195893111c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:18.473233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:18.473859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:18.474142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:18.474417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:18.475103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:18.476472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:18.496727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.sql.core [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:47:18.496727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 06:47:18.496727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [parameters: {'id': '3c9a0a7b680b4231854efb00f7287dfb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 06:47:18.496727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81411) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application result.read() Sep 13 06:47:18.517880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:47:18.518918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application yield resource Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise self.value Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application session.commit() Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:47:18.519848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:47:18.520750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:47:18.521620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application result.read() Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:47:18.522439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [parameters: {'id': '3c9a0a7b680b4231854efb00f7287dfb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:18.523296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 06:47:18.524086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:18.530808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 241/478] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 06:47:18 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:18.530948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:18.592415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:18.683036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcc342-d1a9-4781-9c67-38b3aade9009 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:18.740613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:18.741655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:18.742151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:18.742613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:18.760376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e6d29ac0-e754-4033-9227-a594d49a6890 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:18.765724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:18.766608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:47:18.768131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:18.771124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 238/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:47:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:18.786895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:18.941332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3032f-4ed4-4051-a3ad-ed8fb83cb837 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:18.992418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:18.993297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:18.993743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:18.994157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:18.994962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:18.995420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:18.996973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7bb23-51d6-41b6-99e6-92f4daa987d9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:19.014118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 242/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:20.324307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ca49-d008-4ae7-af95-c5be52dc48b0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.325333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ca49-d008-4ae7-af95-c5be52dc48b0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.325814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ca49-d008-4ae7-af95-c5be52dc48b0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.329420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 239/481] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:20.335420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb49ab-c7c8-4388-8fba-dd2ffbd2e511 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.336334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb49ab-c7c8-4388-8fba-dd2ffbd2e511 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.336832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb49ab-c7c8-4388-8fba-dd2ffbd2e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.369781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5deb49ab-c7c8-4388-8fba-dd2ffbd2e511 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:20.371007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5deb49ab-c7c8-4388-8fba-dd2ffbd2e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:20.388153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:20.464037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 243/482] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:20.495863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba4a6-bd70-4db5-ae49-1821f725eb37 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.496466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba4a6-bd70-4db5-ae49-1821f725eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.497003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba4a6-bd70-4db5-ae49-1821f725eb37 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.498540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 240/483] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:20.504940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661045a-07db-44e9-81b5-1969b2920268 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.505232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661045a-07db-44e9-81b5-1969b2920268 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.505506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661045a-07db-44e9-81b5-1969b2920268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.534363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7661045a-07db-44e9-81b5-1969b2920268 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:20.535633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7661045a-07db-44e9-81b5-1969b2920268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:20.630565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 244/484] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:20.660123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d53e-9b22-427c-8da0-1101d5adf881 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.660730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d53e-9b22-427c-8da0-1101d5adf881 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.661215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600d53e-9b22-427c-8da0-1101d5adf881 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.662967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 241/485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:20.668375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.668922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.669415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.691159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:20.692683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:20.760728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 245/486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:20.785686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600d53e-9b22-427c-8da0-1101d5adf881 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:20.913968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600d53e-9b22-427c-8da0-1101d5adf881 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:20.916146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:20.959233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:20.959870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:20.960144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:20.960417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:20.971728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:20.976617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:20.977508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:20.978306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 242/487] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:20.984878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:20.985255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:20.996937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.122094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f56116-7c46-412e-9f73-792b6456c2a8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.128147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52e17-fe43-4708-b244-2ae1cd9067ab None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.161264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.161873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.162148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.162413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.163173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:21.163276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.163476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.163834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.164164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.164381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.164954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f655de-f9b1-455a-8208-bcb1281bcf48 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.174723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 246/488] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:21.175817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc9c2-9faf-4bb8-89fb-819be9bc22fc None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.176103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc9c2-9faf-4bb8-89fb-819be9bc22fc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.176371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fc9c2-9faf-4bb8-89fb-819be9bc22fc None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.178002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 247/489] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:21.178513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fc9c2-9faf-4bb8-89fb-819be9bc22fc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.183316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b2d0f91c-5482-41c0-9ded-b5a137b83bc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:21.188631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:21.190175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:21.190967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 243/490] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:21.192057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.192319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.192477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.214043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:21.215485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:21.232495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.254762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.296601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 244/491] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:21.296601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.299205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fc9c2-9faf-4bb8-89fb-819be9bc22fc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.340174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.340922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.341263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.341600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.354472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:21.361529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:21.362646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.363625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:21.364670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 248/492] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:21.365604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.409790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d49321-e75c-412d-9948-8557516e0ae1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.456985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.458033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.458613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.459070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.470028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.472460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:21.490266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:21.491168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:21.492006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:21.492006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:21.492006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:21.493831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 245/493] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:21.494141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f29c5-f657-4fb5-b8da-afefa79a6cd8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.495169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.499861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.529638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.539952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.540558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.540863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.541130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.541802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:21.542102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.543467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.559845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 249/494] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:21.559845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.620209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39341c6a-1b29-455f-b061-688bac2cd026 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.657302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.658435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.658723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.658986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.659637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:21.659931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.661335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.669675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 246/495] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:21.670525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.671083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316f3e6-b95f-499a-a8e0-4a1c2cece749 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.712172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.712745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.713026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.713297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.713940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:21.714240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.716061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.734455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 250/496] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:21.735277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.741694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.779391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3a36a-b8b9-4d35-9740-e63166457eaf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.787574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:21.815741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.816361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.816665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.816934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.828603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:21.830088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:21.839976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27d047-9062-4d3d-9748-e587508f212c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:21.844110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:21.845794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:21.846793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:21.846793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:21.846793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:21.846793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 247/497] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:21.847019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.881488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:21.882120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:21.882398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:21.882822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:21.895268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:21.900620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:21.901561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:21.902443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:21.907230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 251/498] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:21.909362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:21.958928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e79898-f073-445b-b8ad-e15d0e16d424 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:21.981556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.001692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.002350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.002596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.002865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.014135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.015935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.028230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ef81-5fd2-4ae3-8d53-a1a33031ce23 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:22.030575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:22.031463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:22.032314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:22.032314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:22.032314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:22.032314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 248/499] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:22.032534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.043378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.068158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.068809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.069088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.069357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.076238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.077755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:22.090522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:22.091404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 252/500] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:22.092929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.134533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fdbf1-5738-4f2a-bea2-94b3293b5080 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.167089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.167678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.167952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.168219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.169125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:22.169246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.170534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.182124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 249/501] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:22.182901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.192339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e888c4-4f4a-496c-9d80-0e871cb978ca None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.213119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.225459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.226053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.226325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.226594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.227252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:22.227551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.228955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bec00-d0e2-4bc7-b269-0d9cd8a04959 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.237398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 253/502] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:22.238539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723238-7c98-4919-9514-62ba3abe7b52 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.238827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723238-7c98-4919-9514-62ba3abe7b52 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.239090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723238-7c98-4919-9514-62ba3abe7b52 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.240266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 254/503] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:22.245003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68723238-7c98-4919-9514-62ba3abe7b52 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.275438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.284566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9a04-7c4a-407d-9d6d-5ad2c732ae2e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.320229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.320865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.321143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.321412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.322047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:22.322346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.323728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.334866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 250/504] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:22.335648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.352663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68723238-7c98-4919-9514-62ba3abe7b52 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.386862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.387459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.387734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.388002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.388785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:22.389084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.390497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.426679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 255/505] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:22.427763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.428000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.442028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d590c-815f-4893-8408-9aea646b2b50 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.476013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.476733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.476961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.477232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.484474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.486050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b4806bd3-4320-47a4-9c2c-3f38fabf364f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:22.498591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:22.499632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:22.500633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:22.501200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86987-d896-406b-a425-be1e7d45505d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.501200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86987-d896-406b-a425-be1e7d45505d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.501326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86987-d896-406b-a425-be1e7d45505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.516797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.519509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-54c86987-d896-406b-a425-be1e7d45505d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:22.521183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-54c86987-d896-406b-a425-be1e7d45505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:22.527867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a332-4e7a-4a08-b494-549826f5c642 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.561900 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.562528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.562813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.563085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.573306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.574764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.587206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 252/507] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:22.588263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c86987-d896-406b-a425-be1e7d45505d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:22.590291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:22.591156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:22.591993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:22.591993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:22.591993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:22.591993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 256/508] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:22.592203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.680371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.701926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c86987-d896-406b-a425-be1e7d45505d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.704293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6853d3-d80f-4a2b-b486-588097d4eeed None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.737525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.738167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.738440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.738552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.738745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.739033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.739308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.739571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.745913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.747364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.752343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:22.760329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:22.761259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:22.762141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 253/509] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:22.762692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.817278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.818717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.870055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc6a3-3310-43ce-ba1a-6ce39703fffc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:22.904797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:22.905400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:22.905676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:22.905950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:22.906672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:22.906977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:22.908410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:22.929638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 257/510] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:22.930294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.933730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:22.946780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 254/511] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:22.947602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:22.974598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.033894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdbfd-fe13-4bee-ac2f-e077df3f3db2 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.051668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9282c80-f5e1-402d-84d6-9143a0e43556 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.068518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.069137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.069413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.069676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.070304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:23.070598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.071964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.087415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 258/512] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:23.087415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.087634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.087634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.087634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.087634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.087949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:23.088250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.089728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.107279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 255/513] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 06:47:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:23.108163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.163194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.197079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b92b5-a445-4311-8b79-4a58effc0d73 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.198605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.212151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4db3-8d5b-4710-9a97-a3c7c7834fbc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.234109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.234739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.235022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.235300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.245802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.246649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.247267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.247355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.247543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.247814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.257716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.259156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:23.261450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:23.262549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:23.263784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:23.263784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:23.263784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:23.263784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 259/514] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:23.263784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:23.277193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:23.278144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:23.278991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:23.278991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:23.278991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:23.282630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 256/515] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:23.283983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.367196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b913b-7440-4f2d-a603-a7c61177ff4c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.383318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8f9d5-0a48-41d4-aa48-8afde6499c0a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.392010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.401176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.401770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.402044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.402310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.418419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.419042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.419321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.419592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.426275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.427585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.429336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:23.441325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:23.442231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:23.443115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 257/516] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:23.443705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.472911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.474538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.541413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b023-134d-45eb-bf19-353ee8c1785b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.578021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 260/517] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:23.578860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.583962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.584389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.584697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.584972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.619147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.633703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.653561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.655018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.677486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c486a-7edc-4a9c-a1e0-6e9799ea18dc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.711964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.712557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.712856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.713120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.713747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:23.714042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.715391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.726211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 261/518] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:23.726986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.755852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 258/519] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:23.756714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.819752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.829913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdfe4f-fa4a-4a57-aa41-d84970b9220e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.844136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:23.853420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d73a-fcda-406a-869f-f46547dc3b94 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:23.865322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.865929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.866207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.866481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.867131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:23.867432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.868830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.880937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 262/520] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:23.881725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.890810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:23.891415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:23.891691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:23.891960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:23.892698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:23.893000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:23.894412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:23.910959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 259/521] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:23.911730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:23.978453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c2a1-17ab-4b69-8566-aebfb81e25c4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.009426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028f48-97ff-4b93-9a06-358bdbf6456e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.011575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.012203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.012479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.012780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.023871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.025091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.037938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:24.040533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.041470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:24.042633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:24.042633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.042633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:24.042633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 263/522] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.042996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.051029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.051631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.051901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.052439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.053104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.054521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.075067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.082024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 260/523] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:23 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:24.082024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.168927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e420-eb77-4a2a-b231-57f79eef59ea None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.191859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981a55-37e2-48e0-92d2-8ccb59825e71 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.210373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.211019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.211298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.211568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.225103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.226603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.227461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.228111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.228505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.228804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.236348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.237937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:24.242470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.243424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:24.244351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:24.244351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.244351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:24.249395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 264/524] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.249736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:24.250993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.252480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.253396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:24.254514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 261/525] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.254514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.305685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.348658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.365765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbecfab-6db7-47ad-b36d-7b086e550172 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.372299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dbde-8304-44e2-abc5-b3044c1877a8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.401129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.401727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.402001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.402273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.402904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:24.403229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.404615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.408656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.409570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.410027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.410469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.417966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:24.418777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.490417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.492470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.540667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fbf8-d28a-4a8a-809f-6031730b00c7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.542792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.572879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.579057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.579851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.580701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.580980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.581625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:24.581929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.583310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.595641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 263/527] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:24.596910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.602197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 265/528] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:24.603227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.704012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14f1f-773f-41c0-8714-2881fb85d7cf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.714254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaefaa-c419-44d3-b274-27dd9db82bd3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.741344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.741895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.742167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.742430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.743109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:24.743406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.744905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.750338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.750960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.751233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.752287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.759268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.760744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.763200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 264/529] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:24.763844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:24.777506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.778401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 266/530] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.784030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.795205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.826197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:24.879635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88adea-4dfd-49c1-b919-2679b0d44bc0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.899012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efb449-d99c-4374-b816-c0db2624438f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:24.919826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.920456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.920780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.921050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.929099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.930616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.934808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:24.935439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:24.935718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:24.935992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:24.942915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.943761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:24.944605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 265/531] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.945068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:24.952837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:24.955445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:24.972609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:24.973522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:24.974367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:24.974367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:24.974367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:24.974367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 267/532] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:24.974367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.032446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.055922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45466b19-c3eb-43fa-93d3-bc838cc8ac1b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.078419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.088498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afcab4-100c-4c94-94fd-b0c98cf33eeb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.100980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.101587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.102023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.102300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.103395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=d52d02c55ffa409d85cdbffa7c30e00d) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.104030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.105690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.124619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 266/533] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/role_assignments?user.id=d52d02c55ffa409d85cdbffa7c30e00d&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.124619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.129076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.129901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.130268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.130631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.131501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.131890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.133552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.157579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 268/534] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.159423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.256706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299bed-d11e-4f1e-9a46-08cc08643259 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.277862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067cc7-6193-46e3-9e6d-cf6c3d0a92e0 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.297176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.298240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.299887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.300376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.301437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.301952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.303893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.317637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.318251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.318532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.318804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.319939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.319939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.321179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.321811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 267/535] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.322960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.334762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.336677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 269/536] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.338344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.352377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.441717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62488e2-9dfb-4cdc-9739-332f40970c46 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.446832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ad08f-c22e-4bcf-b644-2b6e88191118 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.484563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.485695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.486374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.486670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.486914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.487186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.487545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.487916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=6619aa7d0347403ab596d1bfae72e520) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.488226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.488326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.489254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.489714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.489985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.491816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.498379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 268/538] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.499600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.500834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/role_assignments?user.id=6619aa7d0347403ab596d1bfae72e520&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.637770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.690867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb737f7-7a3d-4f90-9abf-72e97102d81f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.727395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.727965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.728243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.728515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.736863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.737941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:25.750975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:25.753137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:25.753976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:25.757308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 269/539] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:25.761737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:25.874749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:25.905677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17b42b-f622-483c-a935-13c0cb42eff4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:25.952874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:25.953852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:25.954335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:25.954881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:25.955978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:25.956489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:25.958171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1949-c917-4c10-9a00-54659dfc5e0f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:25.976225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 271/540] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:25.982474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:26.122116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549d6d-80c4-4059-aaeb-ffaeccae9a7c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:26.162340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:26.173301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:26.174120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:26.174399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:26.174671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:26.175435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=bc9bfa0fb8ee4875a6a9b24607e6a56a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:26.175747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:26.177496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6428caa-396a-4fb1-876e-b29fb669694b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:26.183334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 270/541] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:25 2022] GET /identity/v3/role_assignments?user.id=bc9bfa0fb8ee4875a6a9b24607e6a56a&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:26.500215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9381-8500-4ee7-b3ff-819bb6b4603e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:26.500779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9381-8500-4ee7-b3ff-819bb6b4603e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:26.500779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf9381-8500-4ee7-b3ff-819bb6b4603e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:26.503533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 272/542] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:26.508716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:26.509225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:26.509676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:26.531343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:26.532884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:26.631472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 271/543] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:27.040113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf9381-8500-4ee7-b3ff-819bb6b4603e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:27.179707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf9381-8500-4ee7-b3ff-819bb6b4603e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:27.234271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:27.234908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:27.235183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:27.235447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:27.237784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:27.249920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:27.255082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:27.255955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:27.257184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 273/544] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:27.262271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:27.408505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16124c-ff97-4b7c-ad3a-514c1128f3c1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:27.445612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:27.461239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:27.461859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:27.462135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:27.462406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:27.463072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:27.463372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:27.464758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:27.475605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 272/545] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:27.482210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:27.628840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717476-0cc1-4bc0-a480-f2e1e99f6f02 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:27.682864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:27.683418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:27.683689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:27.684011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:27.697538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:27.698983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:27.718893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:27.721663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:27.723749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:27.723749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:27.723749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:27.723749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 274/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:27.725884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:27.872493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ee03-5206-45e6-bfca-41678dcdaffa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:27.907572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:27.908654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:27.908938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:27.909206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:27.909907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:27.910211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:27.911569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:27.924139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 273/547] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:27.929521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.005605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.091438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f97e-a664-4947-982f-dc50ce88c689 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:28.137429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:28.138063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.138339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.138607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.149378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:28.150821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-bd93c613-7298-4b8d-8739-912c25fc2d83 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:28.165962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:28.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:28.169102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 275/548] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:28.173104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.200231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dbeca-14c8-452d-a5ce-b9694887f0a8 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.200604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dbeca-14c8-452d-a5ce-b9694887f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.200772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dbeca-14c8-452d-a5ce-b9694887f0a8 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.202436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 276/549] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:28.216248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e73-e02b-4781-a054-1a6ddaeef396 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.216597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e73-e02b-4781-a054-1a6ddaeef396 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.216812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7e73-e02b-4781-a054-1a6ddaeef396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.246086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c36d7e73-e02b-4781-a054-1a6ddaeef396 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:28.247864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c36d7e73-e02b-4781-a054-1a6ddaeef396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:28.254375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.316647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef452544-dd32-4044-807d-f8355b42d191 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:28.332760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 277/550] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:28.334111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79641-0140-4f36-b441-4d5adcf98db1 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.334393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79641-0140-4f36-b441-4d5adcf98db1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.334663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79641-0140-4f36-b441-4d5adcf98db1 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.337067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 278/551] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:28.344601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846bcc-6ebf-444e-9d4c-0f08612887e7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.344601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846bcc-6ebf-444e-9d4c-0f08612887e7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.344601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846bcc-6ebf-444e-9d4c-0f08612887e7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.344601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 279/552] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:28.344601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.345081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.345683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.365203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:28.366498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:28.370650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:28.371502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.372084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.372555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:28.374034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:28.376079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49090996-9f95-4d91-b3d5-f012d75d3136 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:28.399522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 274/553] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:47:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:28.400961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.401420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.401907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.402385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.423865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:28.425984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:28.448625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 280/554] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:28.448625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.551437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 275/555] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:28.604983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.605297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66c46-902e-4648-98e0-89e34aa1654f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:28.661180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.676413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:28.677315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.677559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.677887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.725812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.769327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:28.771138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:28.779322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9457-d921-4704-8e33-f6524a45ddd5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:28.825195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:28.826517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.827222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.827647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.841615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5fe44b45-0704-4a46-9eee-0cf70b7b0906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:28.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:28.847570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 276/556] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:28.849941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd1ef-503f-4532-b9fd-e85820876974 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:28.850746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd1ef-503f-4532-b9fd-e85820876974 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:28.850746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecd1ef-503f-4532-b9fd-e85820876974 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:28.855760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 277/557] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:28.855760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd1ef-503f-4532-b9fd-e85820876974 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.884266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 281/558] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:28.884266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:28.946843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.957716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:28.966008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecd1ef-503f-4532-b9fd-e85820876974 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:28.983103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5c5c-679d-4075-8e76-f11671fa68ed None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.000642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.001360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.001705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.001984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.012107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6253df6e-afd2-4033-981e-7f416141943e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:29.017639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.018593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.019414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:29.020030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.020030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.020030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.020766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 278/559] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.020836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.020912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.020987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:29.021056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.021123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.021190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.021833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.032240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 282/560] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:29.033771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.043018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:29.044205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:29.111363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 279/561] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:29.112119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.132826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95c41-05da-421d-a00e-34849e229764 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.160827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.170357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.171230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.171518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.172210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.184760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:29.190437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.191549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.192678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:29.196431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 283/562] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.197539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.200682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.219118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903b97f-77f1-4327-aa5f-52fad6c1d2e1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.254073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.254809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.254991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.255227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.266577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.268782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:29.283014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.284020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:29.284989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:29.284989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.284989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:29.288773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 280/563] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.289646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.309439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401d2f-edfc-4011-abbc-e3cdf9c6f34e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.346777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692813-c839-4204-8d23-75062be8c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.347637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692813-c839-4204-8d23-75062be8c75b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.348086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692813-c839-4204-8d23-75062be8c75b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.348661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91692813-c839-4204-8d23-75062be8c75b None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.349494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692813-c839-4204-8d23-75062be8c75b None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:29.349963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692813-c839-4204-8d23-75062be8c75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.351511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91692813-c839-4204-8d23-75062be8c75b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.365332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 284/564] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:29.366057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692813-c839-4204-8d23-75062be8c75b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.393050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426e7f-898d-465d-a47a-3fbfe7b7ef0a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.418089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.428446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263554-d39d-4196-9801-59aff046403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.429092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263554-d39d-4196-9801-59aff046403a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.429368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263554-d39d-4196-9801-59aff046403a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.429636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263554-d39d-4196-9801-59aff046403a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.432169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.440714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e263554-d39d-4196-9801-59aff046403a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.442181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e263554-d39d-4196-9801-59aff046403a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8e263554-d39d-4196-9801-59aff046403a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:29.456054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.457086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:29.457970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:29.457970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.457970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:29.457970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 281/565] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.457970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263554-d39d-4196-9801-59aff046403a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.473883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91692813-c839-4204-8d23-75062be8c75b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.510266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.510863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.511136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.511396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.512050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:29.512345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.513730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.521753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 285/566] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:29.522545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.574269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263554-d39d-4196-9801-59aff046403a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.608174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.608797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.609073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.609340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.609965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:29.610260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.611666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.619371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776bae1-5e0a-405d-b96a-de8270254c43 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.623714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 282/567] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:29.625378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.633234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.655148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.655777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.656056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.656326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.667607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.669078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.676052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:29.684293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.690511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:29.691621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:29.691621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.691621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:29.691621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 286/568] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.691621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.733152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d2b9b-7b71-4b55-ad5b-4eedc32d4011 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.766616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.767764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.768038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.768302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.778284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:29.784006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.784995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 283/569] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.785875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.796595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aee12e-0c65-4aaa-a114-257a083cc501 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.830700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.831301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.831575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.831840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.832472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:29.832793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.834142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.846620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 287/570] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:29.847422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.872914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.891852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a85e-ec71-4e10-a982-bc1a47375760 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.902918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:29.927802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.928422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.928731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.929001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.938624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.940320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:29.948926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389521f-0c6a-4545-b9f7-67331990438d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:29.955404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:29.956529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:29.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:29.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:29.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:29.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 284/571] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:29.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:29.988595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:29.989226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:29.989500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:29.989765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:29.996224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:29.997687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:30.008499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:30.009663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:30.010552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 288/572] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:30.011052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.061916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d8ca-a3af-4e21-ad86-0bd2afec72dc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.095305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.095910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.096191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.096465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.097143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.097447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.097880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.098841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.111193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 285/573] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.112245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.118528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6d75-4d32-4b13-93f1-a84358fa2f94 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.136079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.154007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.154602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.154881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.155147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.155802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.156098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.157615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.165352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 289/574] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.166121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.214975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551e8d0-d6da-44d8-a043-26210ff021d6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.247983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.248618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.248900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.249164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.256561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.258020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.263779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1723ba-b26a-4528-be22-1bdb46659bba None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:30.270603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:30.271707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:30.272836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 286/575] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:30.274050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.297568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.298204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.298478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.298749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.299394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.299695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.301085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.312751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 290/576] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.313534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.322419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.360647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.380881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43afd-44e6-408d-a6ba-d0a09e9d3aa2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.413672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.414263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391db72-6b01-480a-9ab8-453256da4049 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.414381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.414471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.414715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.415392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.415692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.417159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.429297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 287/577] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.430097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.452476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.453140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.453420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.453692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.461048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.462467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:30.473852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:30.474956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 291/578] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:30.475994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.532149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54605c-68b2-4a77-b38c-21510a1143e5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.543306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.568128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.568787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.569071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.569339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.577377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.580378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.583892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd26e-bd81-4c9d-84a4-6bfcd8b39b56 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.584544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:30.599500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:30.600653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:30.601754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:30.601754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:30.601754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:30.601754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 288/579] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:30.602028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.627441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.628291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.628754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.629181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.630622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.631101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.633033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.651854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 292/580] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.652672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.704118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d15ce-12d7-4a90-a0d4-bdf21ad3e1b0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.738031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.738651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.738928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.739197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.746430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.747862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.748747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712a105-9cbd-4778-bd2f-b6489f54af7f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:30.758992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:30.760088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 289/581] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:30.761061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.773565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.784766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.785367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.785647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.785920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.786644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=421252e103f1435286c0f3b84442c6b7) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.786954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.788419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.793787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 293/582] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/role_assignments?user.id=421252e103f1435286c0f3b84442c6b7&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.794413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.821838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:30.887770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293a4a-375b-4897-80dc-d98af4ef0ffa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.915480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f62e-1290-4c77-855e-73d69f91ba16 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:30.929296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.929991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.930203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.930472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.931215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.931524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.933033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.953793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 290/583] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.955001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:30.959721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:30.960353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:30.960653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:30.960930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:30.961594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:30.961923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:30.963298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:30.977345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 294/584] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:30.978021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.039167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.083230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e80067-9490-4fb8-b2d2-83feeebf2b87 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.092222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403077-7ff4-4ab9-b88a-c5e0f52d1080 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.095833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.121221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.121790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.122064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.122342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.129944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.130197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.130480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.130754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.131491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:31.131797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.133262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.134804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.136252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.151387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 295/585] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:31.151739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:31.152869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:31.153920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:31.153920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.153920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:31.153920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 291/586] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:31.154163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.155196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.262663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac05c-48cf-463e-90bc-c221e2e09816 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.265543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baef537-6946-4e6d-9680-264fd8ded16c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.272568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.303783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.304450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.304756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.305031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.306077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.306710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.307161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.307442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.322078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.324477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.326027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.327457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:31.346563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:31.347522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:31.348462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:31.350728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:31.351929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:31.353162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:31.353162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.353162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:31.354832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 292/587] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:31.354832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.356325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 296/588] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:31.357230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.381263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.461125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3433bf-cc63-4dd0-80c2-f65ae22e4618 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.467730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7cbb3-973a-411a-a9ce-57e7ef592871 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.497293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.497923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.498856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.499126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.506240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.506939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.507308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.507660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.508380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:31.508766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.510220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.511679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.513181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.528286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 297/589] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:31.528286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:31.528571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:31.529555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:31.530442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:31.530442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:31.530442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:31.530442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 293/590] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:31.531061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.560488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.655385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.665444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce793-7fa7-4049-8a7c-d35707014afc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.695913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474f8d-58ae-4b3f-8b9d-3752a657b548 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.722777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.723393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.723670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.723942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.724713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:31.725021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.726539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.735072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.735715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.736548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.736865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.737506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:31.737808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.739177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.748670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 298/591] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:31.748670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.760358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 294/592] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:31.760358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.833011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.861275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9879c-53f3-4518-9e57-2e2808ca584e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.867389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadfe7-20ef-4f50-a2a2-da8a5933156f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:31.897747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.898709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.898986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.899233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.902632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:31.903235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:31.903511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:31.903778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:31.904417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:31.904751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.906115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.906219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:31.908123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:31.908383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:31.919905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:31.920851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:31.921782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:31.922215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 295/593] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:31.922215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:31.926318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 299/594] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:31.926524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.029869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2522c-156c-4d84-88d2-5ef625a3ba87 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.046157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db307e99-d4c3-4234-8304-10f661a8e232 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.066376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.067009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.067287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.067557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.078511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.080000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.083582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.084150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.084422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.084717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.088069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.092600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.094063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:32.095714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:32.096650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:32.097686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:32.097686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:32.097686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:32.099092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 296/595] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:32.100006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:32.106824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:32.107744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:32.108705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:32.109280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.157618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.227591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757cc6e-0c87-4726-9a00-4022c980ed29 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.233358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50150c69-1d3f-4116-a1ad-4593d27e6c60 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.264315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.265059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.265409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.265777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.268187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.268904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.269240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.269573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.270324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:32.270690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.272177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.273281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.275009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.288409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 301/597] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:32.288409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:32.288685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:32.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 297/598] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:32.290729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.357928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.402124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5b1bc-aefe-486e-9915-8ed0d664dcc1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.408943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2928a31-6a33-4b25-92d3-795b30cb2c11 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.410082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.439710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.440317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.440604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.440893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.441557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:32.441855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.443274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.444996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.445870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.445870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.446117 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.446756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:32.447052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.448430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.455947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 298/599] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:32.456488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.465454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 302/600] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:32.466129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.575760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f0d7-0318-46be-af14-d895360759e4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.583390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbed768-4681-4373-bbc6-6834dc22e926 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.601217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.613446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.614035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.614308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.614570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/6619aa7d0347403ab596d1bfae72e520/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.622280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.622901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.623177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.623446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.624134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:32.624439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.625893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.629916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=6619aa7d0347403ab596d1bfae72e520, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.631340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.639925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 303/601] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:32.640671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.649056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:32 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/6619aa7d0347403ab596d1bfae72e520/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:32.649877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.672628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:32.784615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0f7aa-d75e-4f43-aa82-f51947c8fbd7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.797414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab717b6d-b4fe-40e0-8463-ebf10ec14d25 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:32.833100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.834697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.835162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.835595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/d52d02c55ffa409d85cdbffa7c30e00d/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.848380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:32.849507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:32.850328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:32.850905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:32.853482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=d52d02c55ffa409d85cdbffa7c30e00d, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.855194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.860364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:32.863375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:32.878508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:32.879535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:32.880429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:32.881063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 304/603] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:32 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/d52d02c55ffa409d85cdbffa7c30e00d/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:32.882110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.883244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 300/604] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:32.890303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:32.921346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:33.011073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:33.023748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f193-4564-4ab3-bba1-34c5d36ef438 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:33.049002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896944d-dc9b-44ad-ac9b-1c53745d2eea None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:33.070834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:33.071515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.071796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.072067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.091709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=b732fb0cfa4749c3a1e96639ff69e9f1, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:33.093282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c63c-094b-4c27-b095-26ae3aaa2094 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:33.104155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:33.105165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.105919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.106789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.107971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:33.108495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:33.110160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:33.111574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 305/605] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:32 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:33.116605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131588-4edd-4a73-b499-159996c7496c None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.116605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131588-4edd-4a73-b499-159996c7496c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.116605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63131588-4edd-4a73-b499-159996c7496c None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.116605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 306/606] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:33.121787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.122072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.122418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.132092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 301/607] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:33.141464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:33.146562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:33.147797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:33.262610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 307/608] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:33.305286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b0c1-a547-4a5d-9b8b-717b8bded08e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:33.351135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:33.352175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.352698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.353167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/bc9bfa0fb8ee4875a6a9b24607e6a56a/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.358532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:33.372805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=bc9bfa0fb8ee4875a6a9b24607e6a56a, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:33.374521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:33.391943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 302/609] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:33 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/bc9bfa0fb8ee4875a6a9b24607e6a56a/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:33.613111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:33.621713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:33.724014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7242a7-fe3a-4305-986a-65f04fc2e072 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:33.766573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:33.767911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:33.768300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:33.768697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:33.782849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:33.788071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:33.789530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:33.790371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 308/610] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:33.795317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:33.957749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf76d3-2c3a-4a96-ae34-241a28f67300 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:34.018883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:34.019970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:34.020454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:34.020961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:34.021832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:34.022331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:34.023925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:34.036490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 303/611] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:34.041856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:34.129357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:34.177897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b83f-574f-4eb5-ae2a-391831b3266b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:34.221534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:34.222172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:34.222446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:34.222709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:34.234257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:34.237166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:34.256927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:34.257974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:34.258965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:34.258965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:34.258965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:34.261166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 309/612] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:34.266384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:34.350810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:34.425308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8cdf-d338-433a-8174-f88dcdd92cff None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:34.473265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:34.473877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:34.474153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:34.474426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:34.475060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:34.475354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:34.476813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:34.489857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 304/613] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:34.494943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:34.659255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2988e-48b0-4781-85c0-15152c647396 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:34.682121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:34.706515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:34.707157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:34.707439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:34.707711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:34.718509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:34.720491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:34.734233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:34.735212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:34.737167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 310/614] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:34.741327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:34.916444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0ea5-7f2c-4cfb-b988-009ce68ab4b1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:34.926858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:34.957896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:34.959290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:34.959622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:34.959889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:34.961781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:34.962107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:34.963540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:34.986098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 305/615] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:47:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:34.991394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:35.153486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba228-76f4-4268-b77f-325f5212364c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:35.207286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:35.207847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.208125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.208394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.224616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:35.226095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-42b32e75-fb62-41d7-bda9-a28d2eb56f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:35.246233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:35.247223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:35.248768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:35.248768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:35.248768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:35.248768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 311/616] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:35.253316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:35.435269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e900-2ff3-4512-a707-f05c27a6cec9 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.435653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e900-2ff3-4512-a707-f05c27a6cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.435840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e900-2ff3-4512-a707-f05c27a6cec9 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.437641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 312/617] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:35.441344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fb704-bd8c-44b5-92de-60883274bd79 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:35.443361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50236-751c-489b-a39a-fdedfe32885f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.443690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50236-751c-489b-a39a-fdedfe32885f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.443976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50236-751c-489b-a39a-fdedfe32885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.477651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b1f50236-751c-489b-a39a-fdedfe32885f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:35.480290 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b1f50236-751c-489b-a39a-fdedfe32885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:35.497266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:35.498256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.498758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.499237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.500089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:35.500624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:35.502851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:35.530181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 306/618] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:35.531604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:35.533380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:35.581119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:35.642662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 313/619] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:35.644110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c468-2dcb-4d9b-abc6-0c2226c890ce None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.644399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c468-2dcb-4d9b-abc6-0c2226c890ce None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.644712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c468-2dcb-4d9b-abc6-0c2226c890ce None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.650111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 314/620] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:35.651580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.651865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.652137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.667459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cfcd1-e854-4c96-a50e-cef962bfab3f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:35.672438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:35.674760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:35.716161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:35.716829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.717108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.717380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.733094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:35.734478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:35.754000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 315/621] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:35.761681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:35.762568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:35.763446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 307/622] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:35.768444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:35.908981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:35.921772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeda26-5004-4d5e-89cf-f0ac50dfa909 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:35.964760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:35.972332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:35.973427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.973427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.973616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.976633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:35.976633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:35.976633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fceb-6a33-40f9-8132-63e08c528646 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:35.989064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 316/623] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:35.990366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5823-189c-419f-9d24-586daecc4695 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:35.990651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5823-189c-419f-9d24-586daecc4695 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:35.990916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b5823-189c-419f-9d24-586daecc4695 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:35.992338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 317/624] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:35.997606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5823-189c-419f-9d24-586daecc4695 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.090084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.110747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c029-fecf-49d9-ac23-d78146d0ea61 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.122903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b5823-189c-419f-9d24-586daecc4695 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.157864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.159732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.160256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.160767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.163619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.164316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.164619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.165206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/421252e103f1435286c0f3b84442c6b7/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.175990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-85177477-a144-43fd-87d6-feb23cc46358 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:36.182267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:36.183317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.184847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:36.185509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=421252e103f1435286c0f3b84442c6b7, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.185584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 308/625] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:36.185584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.185720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.185803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.185803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.196231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.203844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 318/626] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:35 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/421252e103f1435286c0f3b84442c6b7/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:47:36.204858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.209831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:36.211057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:36.301051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 309/627] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:36.301721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.334624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b676e9-eadd-4383-a19d-1683bf4e9e93 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.373426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.374413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.374876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.375350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.389122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-e6e167c2-59dc-4268-a9f7-26792d5169c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:36.394750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:36.395674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:36.396525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 319/628] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:36.397648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88367-0c32-4cd4-9aa4-d1032b927172 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.397927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88367-0c32-4cd4-9aa4-d1032b927172 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.398200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88367-0c32-4cd4-9aa4-d1032b927172 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.399733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 320/629] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:36.404016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88367-0c32-4cd4-9aa4-d1032b927172 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.416149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.448729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb266a4-c99b-48f3-a03b-380fc474893b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.490664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.492484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.493274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.493556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.494626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.495305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:36.495613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.497019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2da704-88f5-49a5-bcb8-b3ccdb8acc7a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.509581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 310/630] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:36.510854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.511144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.511420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.535678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:36.537044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:36.537617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88367-0c32-4cd4-9aa4-d1032b927172 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.577724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.578261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.578541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.578815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.579524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:36.579823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.581394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.595064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 321/631] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:36.595064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.618343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 311/632] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:36.619272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.701263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.701489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699820-30b0-4996-ad20-fe6b568da7b8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.734021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.744358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b59e3-ee67-494f-b794-7aa704fb7628 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.747794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.748643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.749090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.749534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.761429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.763103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:36.778676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:36.779847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:36.781020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:36.781020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:36.781020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:36.781565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.782274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.783176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.783616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.784032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 322/633] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:36.785127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.799621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.801507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:36.818846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:36.820052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:36.821284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:36.821284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:36.821284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:36.821284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 312/634] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:36.821284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.895803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8ca5-a987-422c-a88b-318fbc1d97ba None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.926158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a107ca-d777-4497-be31-b46c1e4ebead None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:36.937424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.938065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.938434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.939484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.948006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:36.951155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:36.957260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:36.958203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:36.959067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 323/635] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:36.959798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:36.970458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:36.971134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:36.971341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:36.971607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:36.972260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:36.972564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:36.975339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:36.988727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 313/636] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:36.989644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.002811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.076136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc6864-d807-4fa1-abce-ed23a7e78bd1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.099247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbafeeb-aa37-4a9a-9bbc-ae1b43c62716 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.111498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.112106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.112396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.112697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.113342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.113648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.115014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.127802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 324/637] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:37.128684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.139928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.140610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.140893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.141165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.153179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:37.158363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:37.159426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 314/638] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:37.160286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.207623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.238622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.246000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c778-de11-46d4-9a18-e0c8f0bcd7dd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.268866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee345d92-7626-4b1b-969d-5333d4360543 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.292242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.292878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.293154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.293420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.294233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.294407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.295703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.308967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 325/639] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:37.308967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.310635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.311277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.311562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.311837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.319651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.321121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:37.333269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:37.334244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:37.335196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 315/640] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:37.335821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.416930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702801c-4f02-406c-9f9d-e97f7616b18c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.441939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.444802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ae7a-7115-401e-ade8-a2042f150576 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.452874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.453721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.454151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.455074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.462996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.464438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:37.476664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:37.477667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:37.478608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 326/641] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:37.482969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.484715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.485329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.486254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.486550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.487230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.487533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.489014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.503494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 316/642] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:37.503494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.507870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.597056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9f6d-2432-4577-9507-d2850bc32dcb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.605003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca30e-58b5-46a7-a3ca-b4f00993c1e5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.630781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.631500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.631778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.632047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.642660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.644107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.645061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.645758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.646031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.646296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.647056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.647353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.648851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:37.660333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:37.661436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:37.667374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:37.667374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:37.667374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:37.667374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 327/643] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:37.667374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.670905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 317/644] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:37.671766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.695865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.738348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.774801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59dd33-b53c-461e-befe-11de21f86348 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.778505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfeb27-31b1-4937-b0d1-d8df7c1fd67a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.811295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf258-46ff-443e-953d-82444792e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.811903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf258-46ff-443e-953d-82444792e701 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.812182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf258-46ff-443e-953d-82444792e701 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.812454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf258-46ff-443e-953d-82444792e701 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.813214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf258-46ff-443e-953d-82444792e701 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.813524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf258-46ff-443e-953d-82444792e701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.815340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.815694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf258-46ff-443e-953d-82444792e701 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.815977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.816252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.816518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.826596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.828023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.836307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 328/645] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:37.838085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf258-46ff-443e-953d-82444792e701 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:37.842978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:37.843911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:37.845978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:37.845978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:37.845978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:37.845978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 318/646] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:37.845978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:37.924759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.955357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf258-46ff-443e-953d-82444792e701 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.960187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764e6e-2a16-4201-a490-e027e7a3dcfb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:37.982398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:37.992467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.993107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.993391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.993663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:37.994313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:37.994616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:37.995940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:37.996381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:37.996540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:37.996870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:37.997144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.013112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 329/647] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:38.013112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.075116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.076569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.122752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1af461-8870-4d71-8bfe-9239a2af23ab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.149135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.159736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.160377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.160681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.160956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.190554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 319/648] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:38.190554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.227784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.246726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.248187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.301267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99dd4-260d-4ef5-979a-3d8fe97020ec None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.342201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.342912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.343194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.343463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.344104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:38.344403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.346307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.358023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 320/649] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:38.359136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.373484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 330/650] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:38.374588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.397947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.463225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.472174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56075-5521-46ca-a349-5582fb7222eb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.478129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f989-d148-4cfa-a62a-7b9a47dc0405 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.506322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.506951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.507231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.507504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.511907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.512525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.512839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.513109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.514849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.516282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.523101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.524552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:38.527293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:38.528392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 321/651] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:38.529383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:38.539729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:38.540935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:38.542023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:38.542023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:38.542023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:38.542023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 331/652] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:38.542023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.632206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.641367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9692b-7b00-4d50-ad59-cc816bfa874e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.645543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac138-6ad3-499c-84f7-5901ff737041 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.676693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.677576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.677850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.678113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.685663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.687099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.695179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.695803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.696078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.696348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-bb759992-dd2f-4e7d-a4ea-8b2eb1b8a527 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:38.699154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:38.700254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:38.701334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 322/653] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:38.701970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03598-15ef-42f6-8ac5-30e5d738718f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.701970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03598-15ef-42f6-8ac5-30e5d738718f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.701970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e03598-15ef-42f6-8ac5-30e5d738718f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.703711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.707798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 323/654] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:38.708658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e03598-15ef-42f6-8ac5-30e5d738718f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.709049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.710873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:38.726455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:38.727580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:38.728707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:38.728707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:38.728707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:38.728707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 332/655] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:38.728707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.810997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e03598-15ef-42f6-8ac5-30e5d738718f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.828144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933105-fbca-4360-8778-5f92d3b6f3e4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.844489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.845192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.845464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.845728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.846440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:38.846737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.848153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.861697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:38.862284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.862563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.862836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.863466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:38.863767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:38.865176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1a942-8367-4ec8-a44a-d373dab7cea8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:38.865723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 324/656] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:38.866536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:38.877192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 333/657] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:38.878393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:38.878677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:38.878857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.878965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:38.897720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:38.898919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:38.957682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:38.969619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989a780-6c16-4a92-9919-e24df99914ba None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:38.979877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 334/658] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:38.980677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.024074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.024670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.024959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.025227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.026300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:39.026719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.028011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.046800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 325/659] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:39.047845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.095368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96aa0-f0a6-47ac-8834-f2b5f8676156 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.120246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.131738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.132425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.132734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.133001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.133638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:39.133937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.135281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.147204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 335/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:39.148009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.161147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdbc9f-18db-4289-822b-85e7afeaef3a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.191607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.199449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.200050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.200332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.200619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.250756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21e1d-743d-41b5-aa1d-80ef9cd4237b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.272762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.274214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.288791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.289942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.290218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.290485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.297318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.298924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:39.310557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:39.311464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 336/661] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:39.312374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.344354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.380024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 326/662] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:39.380733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.413064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.415741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67649d-2ad2-428d-8a84-2f8aa515252f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.449274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.449883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.450163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.450429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.479540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e0db3-42b8-4b62-8b5f-9ac7f086e839 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.513796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.514347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.514618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.514882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.518762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.520216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.521448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.522856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:39.534556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:39.535488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:39.536381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:39.540380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 327/663] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:39.541104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.569294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.614966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.623468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 337/664] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:39.623468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.639683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d4547-a6b2-40b5-ba6e-e09d298ed8dc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.671304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.671917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.672194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.672511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.683465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:39.688732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:39.689811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 328/665] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:39.690876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.726196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2bbb-de76-46a0-8825-737fbc786d8a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.759393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.760000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.760276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.760551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.761263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:39.761570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.762988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.779474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 338/666] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:39.779474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.779717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.791925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6936c4-956f-4694-afc7-94108a173090 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.825509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.826129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.826403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.826674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.836697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:39.837536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.839005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:39.854136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:39.859727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:39.861155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:39.861155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:39.861155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:39.861155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 329/667] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:39.861155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.879128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb961ad-5288-41ae-b84f-1826f289295b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.912741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.913389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.913665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.913931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:39.914645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:39.914943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:39.916357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:39.928564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 339/668] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:39.929367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:39.957399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80f065-a0cd-495e-b60e-e6e9169c173f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:39.991039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:39.991721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:39.991999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:39.992274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.000741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.003387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.004915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:40.020239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:40.021258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:40.022204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:40.022204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:40.022204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:40.022204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 330/669] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:40.022980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.035558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172983d1-beb3-4f89-aea4-57946e1d8f8e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.055962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.070006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.070693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.070977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.071253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.071917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.072220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.073618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.084638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 340/670] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.084638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.124748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0ee2d-8665-4151-af0b-24572ff93b69 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.156917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.158042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.158314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.158584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.159302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=6619aa7d0347403ab596d1bfae72e520) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.159610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.161078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.166679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 331/671] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/role_assignments?user.id=6619aa7d0347403ab596d1bfae72e520&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.167450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.199370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058fd7e-7ac0-469a-89c0-286b578d926c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.227934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.241968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.242589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.242984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.243253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.244032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.244328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.245764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.264020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 341/672] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.264020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.286141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd954ade-4beb-4b00-8905-f749fd04d74e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.319405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.324213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.324873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.325154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.325545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.326167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=d52d02c55ffa409d85cdbffa7c30e00d) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.326472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.327932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.335201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 332/673] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/role_assignments?user.id=d52d02c55ffa409d85cdbffa7c30e00d&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.336330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.403832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842445fe-5928-4a81-affe-6a40127904eb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.451199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.451853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.452133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.452406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.453085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.453393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.455318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.468618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 342/674] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.469314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.479270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edb85-7139-4697-b4a1-ad22c6a6f2be None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.508740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.530679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.531652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.532001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.534162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.549436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.551038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:40.568795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:40.569816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:40.571079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:40.571079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:40.571079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:40.571079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 333/675] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:40.571079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.619952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1852-12eb-4aa9-8053-6a1164b0484e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.620615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.663034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.663979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.664259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.664509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.674750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.677563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:40.693920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:40.694898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:40.695841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 343/676] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:40.696344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.704621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee563-83aa-42d3-bb32-1def58bca504 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.747313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.748447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.748890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.749802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.760041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.762428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:40.775981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:40.777148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:40.778160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:40.779093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 334/677] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:40.780063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.813043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b572-77d4-42c3-8787-5f8b8fdcf472 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.818813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.851892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.853028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.853297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.853563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.854207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.854506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.855862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.879354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 344/678] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.880609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.902217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7a93f-9d17-4bec-b686-dd1b16569334 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:40.907288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:40.936734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:40.937339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:40.937612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:40.937878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:40.939375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:40.939923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:40.941578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:40.954842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 335/679] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:40.955684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:40.992768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa11e-5adb-480f-96c6-0521073abec3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.040962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.041641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.041915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.042182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.043282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:41.043717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.045344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.058846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:41.061308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 345/680] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:41.062511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:41.070619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a10fb-ba1f-46ad-92d7-b9a4b670aa83 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.114885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.116271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.117081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.117572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.127283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.129883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:41.145370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:41.146393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:41.147342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:41.151177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 336/681] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:41.152004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:41.165953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:41.188266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148d51e-b7c8-49cf-ab65-eaed081b20c3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.227616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.229070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.229546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.230023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.230938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:41.231445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.233487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.241302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 346/682] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:41 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:41.242341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:41.260273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cb662-704c-488f-bdf6-ea350ad66239 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.299131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.299981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.300259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.300528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.301310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=bc9bfa0fb8ee4875a6a9b24607e6a56a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:41.301632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.303469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.310193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 337/683] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:41 2022] GET /identity/v3/role_assignments?user.id=bc9bfa0fb8ee4875a6a9b24607e6a56a&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:41.365159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e5dbe-0858-4c87-9e52-ede265de1166 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.405191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.406084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.406521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.406979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.408251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:41.408732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.410373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.432535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 347/684] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:47:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:41.440754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:41.474867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:41.581708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0f2b-76bc-43df-9a48-5265e07f200c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:41.620637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:41.621146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:41.621418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:41.621682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:41.698315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:41.699800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:41.718364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:41.811031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 338/685] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:41.816348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:41.823529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:41.971527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a068-2115-47c7-88d6-09707693dc76 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:42.015993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:42.018031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.018495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.018986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.040391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:42.042140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:42.062213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:42.063220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:42.064990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:42.064990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:42.064990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:42.066480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 348/686] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:42.071988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:42.213438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94108c17-52f9-42f5-906f-c3aa6a233107 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:42.241461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:42.268683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:42.269308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.269583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.269848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.270496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:42.270795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:42.272147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:42.288728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 339/687] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:42.290292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:42.396312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:42.453175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6b4c0-0562-41f0-972c-5a47bc0039a9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:42.510294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:42.510858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.511130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.511398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.519036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:42.520474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-2dfd7440-c6cf-436e-8b86-1070289c8cea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:42.536472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:42.537460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:42.538941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 349/688] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:42.545680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:42.694961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f9ef8-d282-4abd-90cc-a4be14a9d9a2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:42.738792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:42.739408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.739687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.739961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.740687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:42.740996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:42.742425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:42.754829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7963fe-2717-48e6-8dc8-d9204a128c75 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.755150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7963fe-2717-48e6-8dc8-d9204a128c75 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.755360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 340/689] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:42.755471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7963fe-2717-48e6-8dc8-d9204a128c75 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.756941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 350/690] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:42.761914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:42.763475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c299329-17e5-411e-9d1b-bc84ec214077 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.763750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c299329-17e5-411e-9d1b-bc84ec214077 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.764022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c299329-17e5-411e-9d1b-bc84ec214077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.798508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:42.799320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3c299329-17e5-411e-9d1b-bc84ec214077 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:42.807466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3c299329-17e5-411e-9d1b-bc84ec214077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:42.889329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 351/691] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:42.908548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a283e-dc37-4a08-a782-475bde5b82f1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:42.946443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:42.947097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:42.947373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:42.947638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:42.948364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=421252e103f1435286c0f3b84442c6b7) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:42.948718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:42.950435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48658-1389-402c-8107-98c9553a740c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:42.957826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 341/692] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:42 2022] GET /identity/v3/role_assignments?user.id=421252e103f1435286c0f3b84442c6b7&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:43.027847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869081d0-9f05-4b42-90cc-6156bb9526db None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.028129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869081d0-9f05-4b42-90cc-6156bb9526db None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.028403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869081d0-9f05-4b42-90cc-6156bb9526db None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.030167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 352/693] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:43.036602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.036893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.037166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.067496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:43.068753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:43.163921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 342/694] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:43.220892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869081d0-9f05-4b42-90cc-6156bb9526db None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:43.270689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:43.329175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869081d0-9f05-4b42-90cc-6156bb9526db None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:43.365884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:43.366914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.367428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.367889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] PATH_INFO: `/v3/services/network` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.368702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:43.370297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:43.382210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:43.383240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:43.384104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:43.386870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 353/695] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:43 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:43.393340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:43.429235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:43.488254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:43.499815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15958bd-b3ca-4fa6-ab9d-1320a35e418a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:43.540220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:43.540883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.541161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.541429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.542400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] RBAC: Adding query filter params (name=network) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:43.542699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:43.544408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:43.551593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 343/696] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:43.558829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:43.623278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82a14-7d4a-429d-a3de-1f9d81dd3a83 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:43.638132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:43.667358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:43.668281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:43.669505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.670354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.670842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.677440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eb5cf-4466-42c7-87f5-14f201b02feb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:43.686317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:43.689263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:43.708520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:43.709542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:43.710438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:43.710438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:43.710438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:43.712504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 354/697] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:43.720645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:43.722747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:43.725406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.725847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.726258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.727096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] RBAC: Adding query filter params (type=network) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:43.727540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:43.729947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:43.742181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 344/698] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:43.873887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf636b2e-1e1a-437d-a6ba-c7de825fbb7e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:43.922690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:43.923431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:43.923734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:43.924018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:43.924720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:43.925026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:43.926442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d30b4-f994-429e-87a3-19a47b9db706 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:43.950572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 355/699] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:43.957135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:44.118677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f0fb-2202-4540-8847-5430230ef0ea None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:44.131311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7de4e8-f51f-4e00-aa38-f965d7d621c1 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.131581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7de4e8-f51f-4e00-aa38-f965d7d621c1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.131808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7de4e8-f51f-4e00-aa38-f965d7d621c1 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.133443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 356/700] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:44.138410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.138693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.138967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.157961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:44.159172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:44.173399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:44.174018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.174294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.174567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.175226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:44.176677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:44.192593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:44.218077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 345/701] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:47:43 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:44.270960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 357/702] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:44.611594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:44.629430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:44.726251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80503c4e-e51d-42bb-b96f-92fd1127f52a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:44.770936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:44.771590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.771851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.772119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.772750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:44.774108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6d77f529-aba3-42c6-ba9a-ab8fcaba43d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:44.786575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:44.787595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:44.788451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 346/703] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 06:47:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:44.795861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:44.851059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f63cc-48ca-4a3d-8d46-c94a8be5b28c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.851397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f63cc-48ca-4a3d-8d46-c94a8be5b28c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.851611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f63cc-48ca-4a3d-8d46-c94a8be5b28c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.853321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 347/704] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:44.866505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:44.866787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:44.866968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:44.898101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:44.899286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:44.942119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb46a9-0abb-413a-a5d4-7fdd93b50e65 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:45.008293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:45.008930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.009198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.009463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.012492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:45.012492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:45.012492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:45.027408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 358/705] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:45.033622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:45.050550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 348/706] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:45.057300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:45.147204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1325efd-f581-4525-9ab1-d4bf8c47f201 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:45.198278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:45.198886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.199163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.199434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.200065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:45.200367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:45.201805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:45.213824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 359/707] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:45.375955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:45.387849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:45.496289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1cb9-2b5e-4abf-bb63-efcc7842e907 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:45.537580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:45.538218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.538495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.538773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.552387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:45.557361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:45.558297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:45.559207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 349/708] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:45.565158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:45.703329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:45.731714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88dc22-310c-48bf-b1f2-fc3ba88240dc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:45.774182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:45.774721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.775004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.775272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.775950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:45.776251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:45.777672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5927e79-484d-4d94-ad68-9bb8a6447c6e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:45.792964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 360/709] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:45.799999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:45.885147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:45.921985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa9cd-5b41-4c18-bbd3-5787b5ae79df None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.922524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa9cd-5b41-4c18-bbd3-5787b5ae79df None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.922524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaa9cd-5b41-4c18-bbd3-5787b5ae79df None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.927884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 361/710] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:45.928011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b249936-1eb0-4468-b7e7-af82fe4e050b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:45.931930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.932218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.932489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:45.955210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:45.956862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:45.990702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:45.991347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:45.991627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:45.991894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.009962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:46.013509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:46.030772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:46.031719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:46.033239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:46.033239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:46.033239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:46.034246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 350/711] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:46.038266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.082928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 362/712] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:47:46.176267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb0dc-0a21-4cf5-92d3-5de19aeced4d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.198598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.215722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.216632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.217119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.217566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.218381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:46.218859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:46.221105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:46.234430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 351/713] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:46.240839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.340139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.382607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94306a-4984-4671-8deb-fe5b6a13288c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.397186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.441391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.444232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.444928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.445430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.469067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:46.472342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:46.502856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:46.503913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:46.504925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:46.508052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 363/714] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:46.513827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.587866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887506-fbb8-4f2c-b9d1-43d867e1aa88 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.624424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.624953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.625233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.625508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.636689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c70d61c5-9d69-4be1-a3c5-2fb5d0f3d2cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:46.642115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:46.643202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:46.644038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:46.646841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cb571-0f32-410e-a5cd-73ef3e1d059e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.648070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 352/715] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:46.649387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7c59c-b541-40f4-993c-be3ebe86b433 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.649678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7c59c-b541-40f4-993c-be3ebe86b433 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.649951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7c59c-b541-40f4-993c-be3ebe86b433 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.651679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 353/716] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:46.652550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7c59c-b541-40f4-993c-be3ebe86b433 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.684530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.692814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.693794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.694269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.694755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.695677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:46.696195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:46.697938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6520-a6f1-42d7-b89c-c3ea721687de None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:46.700341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.722095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 364/717] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:46.723776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.724301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.724805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.747248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:46.748499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:46.774958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7c59c-b541-40f4-993c-be3ebe86b433 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.811887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.812552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.812802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.813075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:46.814510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:46.814800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:46.816442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:46.832780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 354/718] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:46.833702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.837371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 365/719] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:46.838484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:46.946612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c13d10-98e4-477d-b987-52821f5784b2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.948321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.961501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25219-3942-435a-be94-3ead7d75f4ae None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:46.986395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:46.992611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:46.992611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:46.992611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:46.992611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.022805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.025498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.025634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.025882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.046758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.048980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:47.071978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:47.072997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:47.073907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:47.073907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:47.073907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:47.077741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 366/720] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:47.079451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.107690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.111002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.253280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5893d2e-1b4e-41d7-b7e6-41f39a5eab62 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.279330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 355/721] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:47:47.280646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.283352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.296716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.297389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.298173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.298700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.299461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:47.299768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.301367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.320680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 367/722] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:47.321585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.357339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.397235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243380-5a2a-4fd2-b8aa-3152723a8aa7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.435189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.435797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.436075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.436346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.437030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.437429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc7e2b-515a-444b-a916-df22e860ac37 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.438501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.464613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 356/723] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:47:47 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:47.464613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.507603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.508178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.508457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.508758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.524806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.526438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.530516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b17eca2f-5230-4ccd-83a2-b5e0c03c60b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:47.549845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:47.550852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:47.551786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:47.551786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:47.551786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:47.551786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 368/724] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:47.554184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bbcba-1a23-4ae6-aa33-b75a3b1ef1ff None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.554184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bbcba-1a23-4ae6-aa33-b75a3b1ef1ff None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.554184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bbcba-1a23-4ae6-aa33-b75a3b1ef1ff None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.555092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 369/725] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:47.556736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bbcba-1a23-4ae6-aa33-b75a3b1ef1ff None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.587848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4afca-1576-4f19-b315-dd08d8edd197 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.638761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.639780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.640136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.640908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.654129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.655714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.666586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1ec63c0b-7ce6-45b6-be86-a3da2d949777 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:47.670129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:47.671253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 357/726] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:47.673165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.673988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.673988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.701224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:47.703089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:47.707981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bbcba-1a23-4ae6-aa33-b75a3b1ef1ff None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.745810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.746455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.746743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.747012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.747665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:47.747965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.749374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.763699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 370/727] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:47.764492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.786470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 358/728] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:47.787331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.841712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.881384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32212d-aa57-4e62-a028-04f0344515ec None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.891169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c1a2-1063-4c4a-beb2-47718e94276b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:47.917780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.918438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.918722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.918991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.919723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:47.920026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.921481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f95825-9eaa-408d-8063-61b7dfd64567 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.927829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:47.928459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.928766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.929036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.931521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:47.936451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:47.937949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:47.941866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 371/729] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:47.943116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6c10-338a-41c6-98fa-22a754773b7a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.943446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6c10-338a-41c6-98fa-22a754773b7a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.943722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6c10-338a-41c6-98fa-22a754773b7a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.945215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 372/730] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:47.948143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6c10-338a-41c6-98fa-22a754773b7a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-08d02623-86dd-4bfc-817e-8d77c183a3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:47.950688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:47.951887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 359/731] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:47.954511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:47.955522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:47.977190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:47.978414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:48.060608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 360/732] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:47:48.060608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.098534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6c10-338a-41c6-98fa-22a754773b7a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.102073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.148425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.149061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.149336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.149607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.166310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0987b7-e350-4424-bcb0-04f0ac84fcb6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.210490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.211582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.212156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.212683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.213594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:48.214113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.215850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.228025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.234939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.234939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.235585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 361/733] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:48.236772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.347122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 373/734] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:47 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:47:48.347927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0698c70-b579-4316-b94b-958243a4b019 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.348041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.349968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.394993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.395987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.396360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.397010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.408692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:48.415139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:48.416051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:48.416916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 362/735] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:48.418190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.458162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.463790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c383-5cc7-45e3-b017-8da92b0f6955 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.506102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.506715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.506991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.507259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.508072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:48.508288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.509745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.515329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 374/736] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:48.515977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.538214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed34c1-f48d-4f59-9f53-b24e74540f58 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.589993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.590606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.590871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.591137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.591815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.593274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.615187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 363/737] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:47:48 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:48.616118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.649058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646532bd-5fce-4fe8-ba95-c550db397739 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.657082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.737082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.739567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.740728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.741271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.759287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.761169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:48.794927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:48.796040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:48.796986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:48.796986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:48.796986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:48.801832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 375/738] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:48.807057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.827662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:48.842237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375410-d9db-44f6-8931-1b9a01127221 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:48.905803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:48.906341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:48.906614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:48.906880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:48.908111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:48.908502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:48.910849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:48.921707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 364/739] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:48.927620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:48.972527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fe909-b671-4af1-bcea-659ff4f26bc1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.026930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.028682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.033428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.033428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.033751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.034433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:49.034633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.036318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.049621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 376/740] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:49.051937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c2d7-787e-48f4-9dd2-c7246ed61c64 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.055677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.092911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.093492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.093817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.094082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.106481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.108037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:49.123547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:49.124539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:49.125481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:49.125481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:49.125481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:49.125481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 365/741] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:49.131053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.144552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.182717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce7fb-e7d3-411d-a60d-35baf9306dce None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.244591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.245277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.245553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.245821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.255372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.256826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:49.281069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:49.282176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:49.283386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 377/742] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:49.288481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444e12-847a-4964-8230-c35b66287ae1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.289427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.330947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.332089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.332595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.333450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.334313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:49.334816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.336402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.345571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.351929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 366/743] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:49.357837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.475413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c764e-bdd4-4f5b-ac58-5e9778baafd3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.476044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59e643-c510-4545-865a-c6478583db84 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.513698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.514548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.514852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.515260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.528601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.528782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.528782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.539110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.539926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.540343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.540782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:49.541191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:49.542316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:47:49.543485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:49.544790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:49.545236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.550484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 367/744] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:49.552538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.562096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.567224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 378/745] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:49.577546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.626765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.677696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be467d4-345e-40ac-aaf0-56f440760830 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.738279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.739286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.739744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.740194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.741145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:49.741630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.743372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.762891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d94c9-cb46-4112-9bc7-27a7fcaea1f7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.763673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 368/746] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:49.773618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:49.820286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:49.821328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.821947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.822399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.823323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=421252e103f1435286c0f3b84442c6b7) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:49.823845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:49.825697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a57d75-7e23-414c-98f8-a4c72e3e7902 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:49.838818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 379/747] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/role_assignments?user.id=421252e103f1435286c0f3b84442c6b7&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:49.925197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437efa0-bb6e-43b5-bb35-b1e5647a5788 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:49.929822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c52a5-007e-4f9d-88ae-724512d0e89f None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.930416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c52a5-007e-4f9d-88ae-724512d0e89f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.930870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c52a5-007e-4f9d-88ae-724512d0e89f None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.932461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 380/748] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:49.939373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:49.939997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:49.940469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:49.964954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:49.975370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:49.976632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:50.012355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:50.012699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:50.012992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:50.013262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:50.084359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:50.112799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 381/749] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:50.140174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:50.142112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:50.280876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 369/750] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:47:50.286805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:50.395810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d85ab-0c6f-4752-89fe-eda7e9e2f374 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:50.437962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:50.438725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:50.438903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:50.439225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:50.461653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:50.463102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:50.479077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:50.480632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:50.482034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:50.482034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:50.482034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:50.482034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 382/751] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:50.486771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:50.507617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:50.565754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:50.604834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:50.637663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea0db9-982a-4ad3-870a-cea05b608528 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:50.708862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:50.709979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:50.710527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:50.711797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:50.715140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:50.715669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:50.717274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:50.734299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 370/752] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:50.739016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:50.745472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343786d-dedb-4546-974f-0d1ae49b9222 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:50.812379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:50.813468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:50.813943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:50.814494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] PATH_INFO: `/v3/services/network` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:50.817054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:50.818646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:50.839685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:50.840755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:50.841598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:50.845404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 383/753] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:50 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:50.850836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:50.891974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:50.940324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c7241-1cf8-4558-908a-d712d9ad9239 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.015129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.016147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.017716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.019177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.024322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:51.030548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3901971-46ad-4d5b-a8cc-81b3d9ea0215 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.037761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.039226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:51.059351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:51.060310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:51.061255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:51.063075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 371/754] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:51.071398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.099518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.100134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.100408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.100704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.101345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] RBAC: Adding query filter params (name=network) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:51.101645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.103010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388951e9-47bd-4661-8b4a-907cda1c346e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.112172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 384/755] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.118182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299620c4-493a-4cf9-a326-7723d864bb72 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.118717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299620c4-493a-4cf9-a326-7723d864bb72 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.119055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299620c4-493a-4cf9-a326-7723d864bb72 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.120674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 385/756] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:47:51.121450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299620c4-493a-4cf9-a326-7723d864bb72 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.206098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdce27-cc5a-4492-ba0e-5e037a708efc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.239799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.240731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.241183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.241623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.242584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:51.243060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.244758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871e416-0a99-4f66-b4f1-23c63678d4da None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.248212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299620c4-493a-4cf9-a326-7723d864bb72 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.258578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 372/757] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.260085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.260565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.261063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.264773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:51.279553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:51.281080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:51.295143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.295806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.296081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.296386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.297059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:51.297355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.299075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.305255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 386/758] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.306589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.341962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:51.364655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 373/759] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:51.365892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.488500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eca7b0-48ca-40a2-a33f-5715f8e62da9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.525462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.526563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.526841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.527405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.528259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=5478fe7a36ca488e97019de5ae467f7e) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:51.528569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.530031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b32f5-cf20-4ea9-bfaa-5ecdc6e300e3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.540756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 387/760] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/role_assignments?user.id=5478fe7a36ca488e97019de5ae467f7e&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.543880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544ed2-bd13-4be7-9c26-53e37e884015 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.545345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544ed2-bd13-4be7-9c26-53e37e884015 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.545836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544ed2-bd13-4be7-9c26-53e37e884015 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.547452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 388/761] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:51.559572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.560205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.560728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.586879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580138f-40bd-4be3-a0c7-62572b7a979a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.593002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:51.595749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:51.643010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:51.657574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.658203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.658477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.658744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.659454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] RBAC: Adding query filter params (interface=public, service_id=69bd5f33e3094318b5a564f9b2130bee, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:51.659755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.661192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.679178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 374/762] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/endpoints?service_id=69bd5f33e3094318b5a564f9b2130bee&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.685053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.724764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 389/763] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:47:51.725730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:51.768973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:51.864099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a6d0-5a21-4637-b902-d8de43b78d09 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.912255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718fbe0-7024-4a7b-beeb-9a14e895967d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:51.933256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.933872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.934197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.934467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.935133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:51.936503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:51.949719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 375/764] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:51.980176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:51.980849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:51.981126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:51.981397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:51.998725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:52.004382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:52.005340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:52.006189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:52.008331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 390/765] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:52.013718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.022278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.129681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:52.196344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:52.205852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6020af-a9d5-47ca-ae92-957afd9e497e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:52.216684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f52c-8ee2-4930-8351-401a04e04020 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:52.253120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:52.254240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.254721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.255468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.256670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:52.257175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:52.258738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:52.259676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:52.260301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.260603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.260940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.261446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:52.262986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:52.270716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 376/766] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:52.276640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:52.277637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:52.278485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 391/767] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:52.280813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.286599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.447544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebf07-af0b-4c8b-ba94-2b556c58ad86 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:52.466778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:52.474587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfbe54-f818-4ecb-9740-eb1aa26a75ad None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:52.493771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:52.494812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.495511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.495864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.510518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:52.512070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:52.513119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:52.513958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.514252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.514520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.515552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:52.515852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:52.517776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605299-b08f-4692-9b18-d3a6861ca73c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:52.524018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 392/768] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:52.525292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcf40-3680-4b73-95ed-cf90066577d7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.525572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcf40-3680-4b73-95ed-cf90066577d7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.525842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcf40-3680-4b73-95ed-cf90066577d7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.527016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 393/769] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:52.529401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fcf40-3680-4b73-95ed-cf90066577d7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-665e2be9-01c7-48c0-a7ab-99a14776fdb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:52.538652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:52.539751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:52.540706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:52.540706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:52.540706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:52.544627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 377/770] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:52.544627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be400-508f-4f11-b288-31c01adf8690 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.544627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be400-508f-4f11-b288-31c01adf8690 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.544627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be400-508f-4f11-b288-31c01adf8690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.560173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:52.570886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-505be400-508f-4f11-b288-31c01adf8690 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:52.572697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-505be400-508f-4f11-b288-31c01adf8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:52.669641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 378/771] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:52.670502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be400-508f-4f11-b288-31c01adf8690 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.684002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fcf40-3680-4b73-95ed-cf90066577d7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:52.801827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:52.803979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:52.805775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:52.806063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:52.806704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:52.807006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:52.808385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:52.829592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 394/772] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:52.843157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:52.923323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:52.938238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be400-508f-4f11-b288-31c01adf8690 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.001555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:53.020874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.021547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.021547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.021547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.022135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:53.022430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.023919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.059707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 379/773] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:53.061933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19846fe-fe59-408f-912e-e3599084470d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.062376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.116621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.117500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.117781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.118490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.119479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] RBAC: Adding query filter params (interface=public, service_id=ec2dfb85aaa84058bcd3b2909a06c0cc, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:53.119790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.121425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.135968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 395/774] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:47:52 2022] GET /identity/v3/endpoints?service_id=ec2dfb85aaa84058bcd3b2909a06c0cc&interface=public®ion_id=RegionOne => generated 194 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:53.136873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.234890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676efe-3ff8-4bf6-bd45-3008a608091f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.269964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbc26-5f10-4b55-84a3-70eb43e573c4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.278681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.279525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.280029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.280373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.291499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.293894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:53.310626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:53.311596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:53.312802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 380/775] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:53.314048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.314166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.314796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.319422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.319422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.322987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:53.328339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:53.335884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:53.336138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:53.338597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:53.340355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:53.342006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 396/776] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:53.342006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.462192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb43ee2-a917-4aad-881d-2babdc2c2c8e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.486922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87835-a55d-4c6e-916f-9a0c15f8a884 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.511818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.512752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.513200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.513615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.514396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.517313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.525669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 381/777] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:53.526757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.541486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.542570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.542995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.545087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.546111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:53.549056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.550769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.598955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 397/778] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:53.604954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.722931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:53.748491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:53.778028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907890d-63c6-4fcf-b0db-79a0fc2f15ab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.778869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61714bb-e7db-4611-bba9-df6d72797253 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:53.823424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.824415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.824995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.825539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.828127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:53.829778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:53.830112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:53.830454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:53.831126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:53.831429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.832816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.839397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:53.841862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:53.843349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 382/779] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:53.849970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:53.862309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:53.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:53.864366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:53.864366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:53.864366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:53.864366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 398/780] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:53.869164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.034637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc925d-1e17-4867-9852-2e3709530c71 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.054614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a2f1d-c5d8-4af0-b421-d3ecad5b7241 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.066647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.101548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.102130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.102411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.102683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.114035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.115346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.116055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.116498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.116681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.117534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:54.118035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.118138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.119865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.119975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a6ce2-24bb-463f-9b31-1f1c715f0d99 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.132998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 399/781] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:54.134491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95626f-d5bf-4b19-ac7e-7b99f041212b None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:54.134691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:54.135579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:54.136470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:54.136470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:54.136470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:54.137349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95626f-d5bf-4b19-ac7e-7b99f041212b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.137787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95626f-d5bf-4b19-ac7e-7b99f041212b None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.139408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 400/783] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:54.139511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 383/783] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:54.140535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.141480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95626f-d5bf-4b19-ac7e-7b99f041212b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.258497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e07fd4-a413-449b-b946-b19aab9bd0f1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.264406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95626f-d5bf-4b19-ac7e-7b99f041212b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.294414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.295053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.295333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.295607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.303322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.304818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.310328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.311300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.311849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.312314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.313703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:54.314179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.315778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9a736b2a-2f3b-400b-911b-ad6c989e4dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:54.317629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:54.318501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:54.319398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 384/784] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:54.320427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.320756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.321039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.336804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 401/785] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:54.338023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.345770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:54.347059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:54.373842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.401579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.426182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 385/786] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:54.427583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.489506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca344cc-afa0-4836-8149-2231165df396 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.557299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.557915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.558244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.558523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.559226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:54.559529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.560994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.588996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 402/787] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:54.593678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.602421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b962-772a-417b-99e9-a3ddf837c606 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.641340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.641860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.642138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.642565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.651178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.652693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:54.666645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:54.667645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:54.668606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 386/788] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:54.674068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.733208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.807873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:54.810876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633d365-841d-4205-8f03-827f777a55e3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.821162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f95e1-8a18-4008-a623-a86662b33268 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:54.847995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.848851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.849285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.849553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.850268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:54.850568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.852094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0be1-4c05-4125-ba55-77002ad23d24 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.858166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:54.858824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.859104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.859375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.861369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=b732fb0cfa4749c3a1e96639ff69e9f1, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:54.862889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:54.870858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 387/789] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:54.872229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c785-b5ff-4449-be0c-c853af767b48 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:54.872512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c785-b5ff-4449-be0c-c853af767b48 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:54.872813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c785-b5ff-4449-be0c-c853af767b48 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:54.874175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 388/790] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:54.874661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c785-b5ff-4449-be0c-c853af767b48 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:54.882333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 403/791] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:54 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:47:54.883229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.015936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c785-b5ff-4449-be0c-c853af767b48 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.018340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.045591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca04865-04b1-44d7-8f91-70fee01ad95d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.060360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.060943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.061681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.061681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.075974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-20b058b1-2054-4c5c-8882-eff3e5776e1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:55.082112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:55.083291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:47:55.084279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:55.088650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 389/792] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:55.090061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.090400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.090677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.108862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.109510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.109786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.110154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.117354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:55.119435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:55.122389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.123857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.134725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:55.141359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:55.142770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:55.143678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:55.143678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:55.143678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:55.143678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 404/793] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:55.143916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.220833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 390/794] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:55.222315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.281549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9ff96-68bf-4279-a266-e4759d38b7e0 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.349066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.349677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.349954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.350521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.351208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:55.352485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.353896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.369908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 405/795] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:55.375998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.390137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.408296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52f558-e500-433d-8e62-0a72f6c8895c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.466397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.467287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.467697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.468129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.468943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:55.469523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.471613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.487580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 391/796] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:55.492529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.508108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.563576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57424e-20c7-4bfa-8aba-a485a07794a9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.604902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.605881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.606346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.606860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.618632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.619068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828893-b157-4ec6-a6b8-579d81542de5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.620093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:55.635993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:55.637240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:55.638401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:55.638401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:55.638401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:55.640725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 406/797] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:55.641875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.663425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.664737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.665160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.665574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.675668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.678487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:55.694431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:55.695543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:55.696697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:55.704497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 392/798] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:55.704497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.729490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.762973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092e422-a481-4b45-83ff-504084cff53c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.777561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:55.803719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.804841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.805448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.805920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] PATH_INFO: `/v3/services/network` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.807085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.809915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:55.825162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:55.826165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:47:55.827008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:55.830454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 407/799] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:55.831518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.845397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7ea5-7463-4b07-baf3-4e3ffa31a1ca None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.881655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:55.882337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:55.882620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:55.882896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:55.883608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:55.883919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:55.885387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:55.906484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 393/800] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:55.908316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:55.965770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9cada-702d-4be6-8e12-75dd7614eb4a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:55.987521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.016979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.017597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.017877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.018145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.019350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:56.019659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.020889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75317de-91e6-440f-ae0e-275e20a2871e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.021126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.037017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 408/801] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:56.038251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.059917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.060525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.061099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.061099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.061701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] RBAC: Adding query filter params (name=network) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:56.061999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.063601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ae223-62df-4c88-ba9d-f5ce24221816 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.068021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 394/802] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:56.069179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca954e8-dab6-4f99-8cae-9f3b1e7afd76 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.069454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca954e8-dab6-4f99-8cae-9f3b1e7afd76 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.069723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca954e8-dab6-4f99-8cae-9f3b1e7afd76 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.071062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 395/803] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:56.071562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca954e8-dab6-4f99-8cae-9f3b1e7afd76 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.091030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.165374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68882228-bd66-4338-abb9-c09a0e726413 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.179774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca954e8-dab6-4f99-8cae-9f3b1e7afd76 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.204253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.204973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.205244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.205507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.212849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.214210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.214334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.214922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.215206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.215476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/421252e103f1435286c0f3b84442c6b7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.217410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=421252e103f1435286c0f3b84442c6b7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.218815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9841-c4ad-4408-a7bb-d6fc49bdc8d2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.222928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:56.227012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:56.233553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 409/804] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:56.234552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.244675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 396/805] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:56 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/421252e103f1435286c0f3b84442c6b7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:56.245979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.246228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.246494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.274298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:56.275529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:56.358475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.363385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7961c2-e096-4299-8ca5-b9685abac6dc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.409322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.409962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.410319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.410600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.411332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] RBAC: Adding query filter params (type=network) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:56.411638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.413153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.423720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 410/806] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:56.423720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.496746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 397/807] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:56.497850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.536511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07216a16-b1c9-4ca0-8952-5ad0c6095eca None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.573172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.573783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.574064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.574340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.575184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:56.575494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.577066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.596341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 411/808] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:56.602654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.633216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.714328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b8c0-25fc-4038-9cc9-5f9451fe75d8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.762482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc7a98-954e-4b88-862a-6b0909a5ce22 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:56.766823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:56.782115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.782734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.783014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.783293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.783965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.785380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.830636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:56.832455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 398/809] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:47:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:47:56.832603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:56.832781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:56.833040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:56.845474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:56.847531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:56.850563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:56.872188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:56.873295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:56.874265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:56.874265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:56.874265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:56.884437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 412/810] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:56.886326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.040996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:57.071691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e835b2-c67d-430f-9155-c137c6845bbe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.072203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923298c-a39a-4c0b-b9d8-3f9fe671ba85 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.112114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.112783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.113062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.113396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.113705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.113991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.114720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.115183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.115350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.115808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.116667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:57.117196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.118651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:57.127390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:57.128664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:47:57.129543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:57.132382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 399/811] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:57.140030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.140726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 413/812] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:57.142500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.198691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:57.264468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304760c-6f20-4c2e-a421-fb7ca81c16e1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.270609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2b45a-09af-47d3-b8af-6dbc58fbaf8b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.299787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:57.305478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.306334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.306617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.306891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.316063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.316526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.317341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.317759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.318167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.318386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.319114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:57.319552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.321166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.326578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 400/813] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:57.333536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:47:57.333973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:57.335036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:47:57.336150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:57.338150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 414/814] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:47:57.343718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.448177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28835c1-6fda-4ee9-aa9c-79649b1f7dab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.455538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414eb2-9c3b-4c6e-8317-ec5153939346 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.463532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:57.485818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.486721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.487176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.487619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.488481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:57.488984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.490543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3204f-9838-4ca8-aef8-af7a1a399f88 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.491595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.492213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.492479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.492913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.493534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:57.494159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.495512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae291fc-3d2b-4ed0-a7c0-bab28a912edc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.500871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 401/815] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 06:47:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:57.502707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc1b4-e74a-46a7-8a6b-1b07fa8ee652 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.502986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc1b4-e74a-46a7-8a6b-1b07fa8ee652 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.503253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc1b4-e74a-46a7-8a6b-1b07fa8ee652 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.508388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 402/816] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:57.508388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc1b4-e74a-46a7-8a6b-1b07fa8ee652 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.508638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 415/817] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:57.513032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.513032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.513032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.531523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:57.533051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:57.584296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:57.608766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 416/818] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:57.608766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.624025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc1b4-e74a-46a7-8a6b-1b07fa8ee652 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.663883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.664661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.665035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.665400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.666165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.667643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.700738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 403/819] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:47:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:47:57.747785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56643-40bd-4714-837a-0dbbd5d9f990 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:57.794056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:57.794731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:57.795045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:57.795330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/5478fe7a36ca488e97019de5ae467f7e/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:57.812700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=5478fe7a36ca488e97019de5ae467f7e, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:57.814800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:57.831198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 417/820] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:47:57 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/5478fe7a36ca488e97019de5ae467f7e/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:47:57.887104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:57.920202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:58.003848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7a82e-153a-4b4c-a571-76c31481dd5c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:58.050768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:58.051499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.051777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.052042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.063076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:58.068284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:58.069272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:58.070575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 404/821] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:58.075574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:58.105428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:58.182075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f978-d01f-468f-a124-cef78c09609f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:58.333343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:58.334317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.334801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.335294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.336158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:58.336698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:58.338275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:58.347585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 418/822] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:58.353936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:58.452693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:58.469101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d1b2-f17e-4a6f-9631-0e44b95caef7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:58.505619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:58.506530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.506958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.507377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.518636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:58.520503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d9770d87-2f37-4452-9381-81c1864cc5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:58.536268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:58.537520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:58.538630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:58.538630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:58.538630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:58.540417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 405/823] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:58.545985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:58.649104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:58.658929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d9e0-3ae9-4a06-bb81-3fca2d182353 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:58.682487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9863a8-0457-4a86-aede-ddc61f051820 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.682773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9863a8-0457-4a86-aede-ddc61f051820 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.683053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9863a8-0457-4a86-aede-ddc61f051820 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.688737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 406/824] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:47:58.690596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.690918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.691345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.694907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:58.695617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.695848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.696073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.696880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:58.697287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:58.698790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:58.713207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 419/825] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:58.713412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:47:58.714597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:47:58.725047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:58.804687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 407/826] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:47:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:47:58.850082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b1dd-b85c-4fd1-87b9-d545940a3b15 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:58.888834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:58.889503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:58.889783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:58.890052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:58.897391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:58.898875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:47:58.911249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:58.912178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:58.913174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 420/827] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:47:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:58.917935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:58.986219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.029839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417f089-7323-41bd-bffc-4a42dff8423e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.065726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.066596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.067012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.067420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.068278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:59.068757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.070334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.090146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 408/828] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:47:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:59.096606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.109495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.113416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.220478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45b5b-89f9-414f-a100-f8f37ddf6018 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.244153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ba80-4c47-458f-88cb-3b6626bcab64 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.261636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.262735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.263190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.263930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.274060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.284603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.285384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.285755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.286120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.297906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:47:59.303932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:59.304900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:59.305738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 409/829] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:59.314007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.349795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.351447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.365492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.428987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63873-fa0b-4e60-a7c2-737ad3185f1d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.467254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.467861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.468134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.468398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.469161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:59.470472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.471959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.480673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 410/830] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:47:59.486537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 421/831] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:47:59.490153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.491992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.542771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.604393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88cd4f-6ce1-402d-9ba6-4aec42d7eeed None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.615793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb87-a009-4275-a319-8de1ff339473 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.630003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.641833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754655f-f346-4f29-8978-597f99634204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.642466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754655f-f346-4f29-8978-597f99634204 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.642744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754655f-f346-4f29-8978-597f99634204 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.643012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754655f-f346-4f29-8978-597f99634204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.655773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754655f-f346-4f29-8978-597f99634204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.657924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754655f-f346-4f29-8978-597f99634204 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.662671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.663882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.664370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.664907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e754655f-f346-4f29-8978-597f99634204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:59.673662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:59.674652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:59.675557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:59.675557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:59.675557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:47:59.679620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.680135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 411/832] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:59.681064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754655f-f346-4f29-8978-597f99634204 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.681810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:47:59.700439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:47:59.701446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:47:59.702352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:47:59.702352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:47:59.702352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:47:59.705408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 422/833] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:47:59.711919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.807111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:47:59.811148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754655f-f346-4f29-8978-597f99634204 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.850984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebf9a-e859-4e0d-aac6-5ec01eb1ad91 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:47:59.852768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.853536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.853808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.854073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.855496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:59.855804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.857190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.877141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 412/834] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:59.881170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.898395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:47:59.899632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:47:59.900673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:47:59.901350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:47:59.902300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:47:59.903079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:47:59.905122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:47:59.928068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 423/835] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:47:59.929979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:47:59.966831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.007523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464389-3efa-49b5-827d-e4f1cd35db19 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.062233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.062796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.063248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.063514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.072356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.073865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.080984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d5594-ad36-43c5-bdae-fb64d8603a9d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5f129f3e-cacb-41d3-8e4d-538d768a2369 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:00.086759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:00.087758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:00.089371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 413/836] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:00.090000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d2bf6-dde5-4e6c-82c2-d3233e7bd3a9 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.090000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d2bf6-dde5-4e6c-82c2-d3233e7bd3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.090146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d2bf6-dde5-4e6c-82c2-d3233e7bd3a9 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.091437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 414/837] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:00.096501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d2bf6-dde5-4e6c-82c2-d3233e7bd3a9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.120148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.128622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.129368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.129647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.129913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.137274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.138826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b2ce0b51-6779-4b1e-bae9-f58cc97d2c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:00.151329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:00.152427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:00.153684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:00.157855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 424/838] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:00.158950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.159232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.159507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.178269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:00.179522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:00.202266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d2bf6-dde5-4e6c-82c2-d3233e7bd3a9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.236422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.237075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.237349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.237624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.238341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:00.238644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.240055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f1d3-e743-4eaa-bcb3-4f7f1b079d0c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.244472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 425/839] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:00.245339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.258097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 415/840] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:00.259209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.263934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282f28-9268-4b71-888b-846aab72e4fa None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.264224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282f28-9268-4b71-888b-846aab72e4fa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.264497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb282f28-9268-4b71-888b-846aab72e4fa None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.265781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 416/841] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:00.267169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282f28-9268-4b71-888b-846aab72e4fa None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.355202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.361760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00920-2b33-40ee-a731-85262a143474 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.380442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb282f28-9268-4b71-888b-846aab72e4fa None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.398077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.398674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.398944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.399208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.399891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:00.400188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.401748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0666874-8b39-4483-8404-b9fb7d4d0382 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.414867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 426/842] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:00.416065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.416326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.416606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.420083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.420731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.421007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.421279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.435834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:00.437135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:00.491210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.492770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.516408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 427/843] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:00.516408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.519235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.576213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.604971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 417/844] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:00.604971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.626785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a450611-1869-4787-8b4b-3fd273cb74ba None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.663427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.664188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.664485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.664768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.665486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:00.665816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.667236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.673983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 428/845] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:00.674797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.729171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29ee48-aced-4831-acfa-ad3fd2426181 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.782015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.782746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.783902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.785104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.785704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.786850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.788843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:00.803721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:00.805004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:00.805865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 418/846] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:00.806683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.826321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ccfa-9d4b-4d9e-83b4-ca32ebacbbb6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.854083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:00.864732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.865384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.865664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.865936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.878728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:00.880115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:00.897711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:00.898902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:00.900145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:00.900145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:00.900145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:00.900145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 429/847] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:00.900145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:00.923456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfdad-e11a-47ae-a89d-d83b0d4e89f5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:00.963776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:00.964413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:00.964765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:00.965038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:00.976416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:00.981692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:00.982832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 419/848] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:00.983832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.021811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17e3d0-1244-43eb-b01d-fe44f5117815 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.039623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.057458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.058069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.058358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.058628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.059259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.059584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.061013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.066817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 430/849] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:01.067803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.122841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8a1b-4caa-48c5-aa58-c2b029c97f18 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.127008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.162246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.162771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.163049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.163314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.163954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.164264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.165678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.177980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 420/850] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:01.178785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.179328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e735ae-85df-4ddb-9ed3-7949a74a6667 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.220448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.221103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.221385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.221654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.222324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.222628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.224017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.232527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 431/851] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:01.238972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.284820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4595b-f511-4fbc-8c50-c4624c9bb733 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.287735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.320690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.321306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.321586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.321854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.322486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.322788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.324564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.336611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 421/852] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:01.336611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.363545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867aead-d0e4-4cb2-a12d-7b7051cda2fd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.368945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.406975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.407928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.408356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.408815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.416517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.418256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:01.431507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:01.432469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:01.433435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:01.435898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 432/853] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:01.442715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.471800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94819d-a567-4434-a1fc-5a7a4816146f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.521887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.522514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.522787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.523056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.536329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.538367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:01.556940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:01.557985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:01.558887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:01.558887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:01.558887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:01.558887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 422/854] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:01.564952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.570872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c348a6-a547-4fca-9c5b-8afceaab4027 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.581528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.611511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.612609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.613085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.613564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.614437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.615243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.617744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.633636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 433/855] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:01.638925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.651309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.677894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0323-d47b-4ddf-b2b4-fafd4e88d8de None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.716189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.716837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.717142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.717529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.718175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.718479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.720176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.737145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 423/856] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:01.744475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.770255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d123d43-bdd6-4f1e-b08c-f89c6b50a969 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.807240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.807835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.808108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.808374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.809216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=421252e103f1435286c0f3b84442c6b7) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:01.809624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.811032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.824997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 434/857] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/role_assignments?user.id=421252e103f1435286c0f3b84442c6b7&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:01.858545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831906df-f554-4a9c-aabf-9c08f20c98b7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:01.900031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:01.900729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:01.901011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:01.901279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:01.910356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:01.911827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:01.914195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:01.925763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:01.926773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:01.928058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 424/858] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:01.932803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:01.968212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:02.053866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97cdd-dbc6-4ac3-8b80-21b09b1260bb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:02.088264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:02.088891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.089165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.089429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.090149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:02.090448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:02.091886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:02.111215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 435/859] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:48:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:02.116753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:02.226040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee96b27-2018-4b07-806c-0b000ce68a97 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:02.262970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:02.263921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.264422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.264914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.339053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:02.343451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:02.346564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:02.457006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 425/860] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:02.463990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:02.554116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:02.570911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02464bb5-2ac1-4eb6-a8ef-cb000bb39d95 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:02.606270 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:02.606940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.607214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.607525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.617708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:02.619129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:02.634319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:02.635304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:02.636628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:02.636628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:02.636628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:02.639985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 436/861] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:02.641457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:02.749935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5f6ff-499c-48a2-ba2b-591e4632681b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:02.752629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:02.787767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:02.788369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.788668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.788934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.789568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:02.789860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:02.791202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664d780-5c1f-4727-bd62-d1ff378cffcd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:02.803688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 426/862] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:02.809058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:02.925406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d260c-690d-462f-9ff0-5b8cf8d023a0 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:02.961830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:02.962457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.962729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.962992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.965485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fea28e-a7b2-49a3-bf14-fd70a4ddc816 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.965776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fea28e-a7b2-49a3-bf14-fd70a4ddc816 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.966054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fea28e-a7b2-49a3-bf14-fd70a4ddc816 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.967631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 427/863] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:02.969896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:02.971423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:02.972772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:02.973059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:02.973165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:02.973323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:02.986470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:02.987418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:02.988342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:02.988812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 437/864] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:02.993688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:02.998049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:02.999451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:03.088966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 428/865] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:03.112634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e85fe9-b61e-4a6e-82a1-e4fd953f3f4d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:03.150671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:03.151683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.152178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.152682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.153619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:03.154116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:03.155727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:03.176078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 438/866] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:03.189326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:03.292034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:03.305898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369bf1d-b274-49d6-82d5-93adf1af9da9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:03.341776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:03.342309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.342587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.342912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.343645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=5478fe7a36ca488e97019de5ae467f7e) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:03.343997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:03.345980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:03.352350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 429/867] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:03 2022] GET /identity/v3/role_assignments?user.id=5478fe7a36ca488e97019de5ae467f7e&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:03.376349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:03.446962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:03.497344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15754fb6-0c6f-4dde-9032-0a5685e2e037 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:03.540231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:03.541255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.541535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.541808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.542424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:03.543837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8909d417-ee0a-4c61-a098-282cc7e952cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:03.555002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:03.556062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:03.557440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 439/868] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 06:48:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:03.562695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:03.669966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b2a9-c58b-4473-bca4-b84a779025e2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:03.677649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6b49-e1a2-4a13-989b-dffc204378f8 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.677925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6b49-e1a2-4a13-989b-dffc204378f8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.678186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6b49-e1a2-4a13-989b-dffc204378f8 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.679785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 440/869] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:03.684863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.685329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.685722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.709510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:03.710702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:03.713781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:03.714393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.714667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.714933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.715556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:03.715852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:03.720079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:03.725920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 430/870] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:03.731288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:03.768973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:03.791802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 441/871] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:03.856983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef26b9-e7aa-4f06-ad84-48a200694716 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:03.896227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:03.896867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:03.897141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:03.897408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:03.898036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:03.898334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:03.899749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c03fb-64aa-4127-96d8-27c1986e1216 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:03.904802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 431/872] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:04.083983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:04.141621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:04.194488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae7dc-e206-46ed-8d41-c90e9a9b922a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:04.233052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:04.233660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:04.233935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:04.234200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:04.235437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:04.237509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf403-ebe4-4d87-93c0-188ee4bcef78 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:04.257859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 442/873] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:04 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:04.317304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e09-a3f6-4b37-8731-140a784c780e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:04.317505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e09-a3f6-4b37-8731-140a784c780e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:04.317740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115e09-a3f6-4b37-8731-140a784c780e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:04.319410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 432/874] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:04.325536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:04.325848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:04.326077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:04.346672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:04.347875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:04.435686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 443/875] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:04.710492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115e09-a3f6-4b37-8731-140a784c780e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:04.799986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:04.822146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115e09-a3f6-4b37-8731-140a784c780e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:04.865390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:04.866042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:04.866314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:04.866580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:04.867171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:04.868566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:04.879142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:04.881226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 433/876] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:04.886654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:04.926522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:04.997520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74cea9-43ba-4790-bcd7-b66649d82867 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:05.032935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:05.033547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:05.033824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:05.034091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:05.034721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:05.035019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:05.036372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f32aab-54b5-4395-a1a3-a7c14991a6dd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:05.041318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 444/877] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:05.049000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:05.155240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16e645-869f-48c0-8618-282bcb80bf83 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:05.191672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:05.192341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:05.192636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:05.192905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:05.193532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:05.193826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:05.195179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31c241-e51c-49d9-b1b3-3e34e132056b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:05.200090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 434/878] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:05.765301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fa2e-ab2e-441c-85c9-f5034bde3d22 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:05.765841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fa2e-ab2e-441c-85c9-f5034bde3d22 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:05.765841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4fa2e-ab2e-441c-85c9-f5034bde3d22 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:05.768442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 445/879] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:05.773976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64e3b-787a-413b-a7c4-962e79d05592 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:05.774401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64e3b-787a-413b-a7c4-962e79d05592 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:05.774574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64e3b-787a-413b-a7c4-962e79d05592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:05.793772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-05f64e3b-787a-413b-a7c4-962e79d05592 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:05.794982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-05f64e3b-787a-413b-a7c4-962e79d05592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:05.797151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:05.872692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 435/880] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:06.145552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4fa2e-ab2e-441c-85c9-f5034bde3d22 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.241084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056da2f-fa3c-4170-9579-8ab328315e66 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.241461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056da2f-fa3c-4170-9579-8ab328315e66 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.241813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056da2f-fa3c-4170-9579-8ab328315e66 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.243355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 436/881] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:06.250142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.250693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.251062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.254496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4fa2e-ab2e-441c-85c9-f5034bde3d22 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:06.256192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:06.270736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:06.272068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:06.293930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:06.294485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.294762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.295033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.307745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:06.313725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:06.314693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:06.315567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:06.324712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 446/882] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:06.326981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.369865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 437/883] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:06.448770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643552cc-f4d5-4e6f-92db-84b2a7e26c94 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:06.487513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:06.488392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.488858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.489298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.490125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:06.490583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:06.492111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aca09c-314e-4d4d-ae39-fef507e4ca0d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:06.501288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 447/884] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:06.508615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.561680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7026b2-c7cd-4184-a785-4bce7e11cb25 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.562344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7026b2-c7cd-4184-a785-4bce7e11cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.562907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7026b2-c7cd-4184-a785-4bce7e11cb25 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.564721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 448/885] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:06.569574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.569854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.570233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.581506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:06.591406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:06.593066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:06.617626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9bc18-dbc4-49e0-bd1c-442ba2f75a06 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:06.625165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:06.659685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:06.660837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.661256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.661816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.676763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 449/886] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:06.676763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.679043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:06.680141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:06.696661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:06.697746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:06.698657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:06.698657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:06.698657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:06.702786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 438/887] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:06.704234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.787827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb35672-3684-4963-b556-e911c43628d9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:06.811471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09733c-4dc2-4671-a430-bac67470063c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:06.829859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:06.830810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.831387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.831896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.832923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:06.834585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:06.835283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:06.854347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 450/888] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:06 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:06.864093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:06.865213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:06.865864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:06.866344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:06.867231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:06.867778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:06.869526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:06.886745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 439/889] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:06.892929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:06.930181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:06.962426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.023698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6561a-727d-4031-a654-a593c3554eab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.071826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.072510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.072907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.073179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.083743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.085765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.096416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870705-7a03-4024-8ba8-5dbc4cf843c5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:07.098826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:07.099817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:07.101304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 451/890] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:07.105564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.139574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.140210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.140482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.140780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.141762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.143116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:07.151764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:07.152818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:07.154242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 440/891] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:07.159372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.210282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.215380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.243723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08cfd-1104-4ebb-8300-d2741ca0671a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.270349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a770d-d337-48d8-a3c9-0a36e306e9bb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.283454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.284205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.284593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.284960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.285781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:07.286181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.287694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.307633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 452/892] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:07.313120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.320936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.321592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.321871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.322138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.322784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:07.323076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.324446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.335659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 441/893] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:07.344633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.445536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba1b9-f58a-4fbb-a81f-3fa5138b7ff8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.480743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ef33-a073-4f5d-8772-762a2b596dca None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.482904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.483905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.490442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.491454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.491744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.492017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.515788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.516958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.517238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.517509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.518143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:07.518441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.519815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b041ac8-8af3-4fdd-8226-591b43517c0f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.529457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 442/894] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:07.529457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5782cd-a173-4c57-bdb9-4db0e89291bd None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.529457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5782cd-a173-4c57-bdb9-4db0e89291bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.529457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5782cd-a173-4c57-bdb9-4db0e89291bd None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.529457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 443/895] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:07.530202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5782cd-a173-4c57-bdb9-4db0e89291bd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.579943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.581535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.639212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5782cd-a173-4c57-bdb9-4db0e89291bd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.675351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.675968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.676246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.676513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.677531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] RBAC: Adding query filter params (interface=public, service_id=87a9b44c56334ba8928eb892d27195df, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:07.677837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.679197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791e2e-0894-4c51-b23d-731c26e39550 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.689450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 444/896] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/endpoints?service_id=87a9b44c56334ba8928eb892d27195df&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:07.689450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.689450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.689450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.699674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 453/897] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:07.699674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.705754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:07.706945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:07.731333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.732896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:07.777923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 445/898] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:07.779277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:07.816310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af2054-b348-4e8e-b401-b34b1a9d7ef9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.855050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.855689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.855967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.856236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.856889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.858373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.868743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 454/899] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:48:07.901664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a963-8e90-4148-a010-b79fb2288e8c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:07.941206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:07.942341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:07.942840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:07.943332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:07.955299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:07.957304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:07.974721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:07.975737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:07.976659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:07.976659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:07.976659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:07.979009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 446/900] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:07.986242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:08.087106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:08.100706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:08.104564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:08.108120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ccdd9-dbb8-467f-bf77-7f55f215cacb None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:08.148846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:08.149460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:08.149739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:08.150010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:08.150659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:08.151021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:08.152443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:08.166371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 455/901] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:08.171795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:08.217177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853836-dc3c-4d5e-978a-d231d7dc5d1f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:08.268083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:08.268745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:08.269024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:08.269294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:08.270509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:08.272153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:08.283120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a92a12-00b7-4dfd-9689-e9b868d925ff None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:08.300443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 447/902] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:08 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:48:08.336355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:08.337479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:08.337990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:08.338461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:08.347867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:08.350011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:08.364134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:08.365195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:08.366100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:08.368802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 456/903] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:08.375169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:08.470856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:08.501905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff842bf-01bb-432b-8394-4c1f40c4125d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:08.537212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:08.537820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:08.538092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:08.538358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:08.539102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:08.539404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:08.540853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330012-92c7-44fc-ab76-95eb1771b18b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:08.555190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 448/904] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:08.561271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:08.579681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:08.671920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0cd1-f800-4c87-8193-d3b28ab1923b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:08.708304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:08.708942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:08.709218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:08.709484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:08.710214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] RBAC: Adding query filter params (role.id=1960f938850b4b85958456734206956c, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=5478fe7a36ca488e97019de5ae467f7e) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:08.710518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:08.712030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f125c-b01d-4635-b50d-e85c656d33f2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:08.717986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 457/905] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:08 2022] GET /identity/v3/role_assignments?user.id=5478fe7a36ca488e97019de5ae467f7e&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=1960f938850b4b85958456734206956c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:09.171131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53677f2-d9a4-48d0-9900-b5ca95e9ad29 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:09.171647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53677f2-d9a4-48d0-9900-b5ca95e9ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:09.171647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53677f2-d9a4-48d0-9900-b5ca95e9ad29 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:09.173939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 449/906] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:09.180323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:09.180323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:09.180323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:09.200082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:09.201652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:09.283213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 458/907] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:09.560698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53677f2-d9a4-48d0-9900-b5ca95e9ad29 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:09.671442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53677f2-d9a4-48d0-9900-b5ca95e9ad29 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:09.709658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:09.710298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:09.710577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:09.710851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:09.711437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:09.712914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:09.714741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:09.723388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:09.724539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:09.725670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 450/908] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 06:48:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:09.732816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:09.742162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:09.837034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda34281-373e-498b-88c3-06f1640d1b72 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:09.873021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:09.873633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:09.873959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:09.874205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:09.874794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:09.875091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:09.877801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:09.882994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 459/909] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:09.888828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:09.998103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1758ec-aaa5-4fb9-9e74-bde2769f7bc3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:10.039696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:10.040701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.041183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.041651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.042477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:10.042990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:10.044560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:10.050884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 451/910] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:10.060230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:10.131024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:10.165508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f6c2-361a-4863-9a77-48ec028a53c3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:10.207051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:10.208470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.208981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.209448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.210343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] RBAC: Adding query filter params (interface=public, service_id=89b6db76302045f4a5aaa57c3cb0f229, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:10.210850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:10.212492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f94bb-30ca-4e90-b629-9a54341cb753 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:10.218345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 460/911] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:48:10 2022] GET /identity/v3/endpoints?service_id=89b6db76302045f4a5aaa57c3cb0f229&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:10.224635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:10.289326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:10.296712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ac29-ec0c-434f-94d5-677e43be4609 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.299167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ac29-ec0c-434f-94d5-677e43be4609 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.301104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ac29-ec0c-434f-94d5-677e43be4609 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.303207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 461/912] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:10.308506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145d5e2-a004-48f7-b544-824090d4e7ac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.310816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145d5e2-a004-48f7-b544-824090d4e7ac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.311308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145d5e2-a004-48f7-b544-824090d4e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.334905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5145d5e2-a004-48f7-b544-824090d4e7ac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:10.335520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdbfc8-9b67-4a53-8f8e-b88cfe143944 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:10.336714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5145d5e2-a004-48f7-b544-824090d4e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:10.372103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:10.372644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.372922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.373190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.373845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:10.375138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:10.381950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 452/913] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:10 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:48:10.429011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 462/914] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:10.709160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:10.711764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fcd0-136a-40a8-8e69-a712aaf684ea None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.712415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fcd0-136a-40a8-8e69-a712aaf684ea None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.712821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9fcd0-136a-40a8-8e69-a712aaf684ea None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.714466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 463/915] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:10.720549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.720878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.721156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.740906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:10.742109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:10.810072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:10.820511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 464/916] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:10.839436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349c09a-ca63-44b1-bd5c-3d373f58e82a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:10.870936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:10.881924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:10.882570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.882843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.883107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.883691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:10.885102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-cc92d1ea-6c8b-45b2-9fdb-cf56cbe7fc73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:10.895895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:10.896947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:10.897792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 453/917] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:10.904892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:10.976811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e2f2-94e2-4ca0-81eb-623c0021aea8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.976995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e2f2-94e2-4ca0-81eb-623c0021aea8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.977260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75e2f2-94e2-4ca0-81eb-623c0021aea8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:10.978964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 454/918] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:10.983769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:10.984052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:10.984324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.004782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:11.006066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:11.026100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc88f-69fa-4f0a-9801-ac9c63e90554 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.067276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.067986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.068269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.068703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.069348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.069650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.071260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.077565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 465/919] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:11.083785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.100675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 455/920] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:11.110492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.161815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.212361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60506d1-2810-4106-971e-8c6db7ce792a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.224368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfecff-f8ba-4d9d-81b6-5cdbe2acbf29 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.253457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.256018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.256775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.257154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.257621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.258243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.258904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.260222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.272053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.272715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 466/921] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:11.273133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.273568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.273832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.274135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.274890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.276411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:11.289636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:11.290704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:11.291563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:11.299502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 456/922] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:11.300225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.403632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0383044-0b36-4df0-bf95-ed53280d814a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.426143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a946e-85d5-406e-b096-0810fd1eaa4b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.430676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.444975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.445585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.445864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.446135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.446807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.448154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.461735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.462389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.462667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.463066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.463868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.464214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.465749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.470917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 457/923] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:11.470917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.481755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 467/924] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:11.481755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.527701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.586485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a744a26-4a21-413d-80fa-25fa21f23cf7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.630932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da657a-9450-4eb6-b3aa-a83594f4dbff None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.631912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.632707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.633084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.633455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.646390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:11.651554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:11.652692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:11.653553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 458/925] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:11.659269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.675711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.676253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.676526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.676819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.677743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.678009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.679382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.685515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 468/926] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:11.694843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.745063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.786019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d53e16-101e-434a-a91a-252d382dcb43 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.788372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:11.822377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb663f-90ad-4c41-a2dd-75427113c650 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:11.825672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.826484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.826907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.827331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.828140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.829130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.831058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.841903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 459/927] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:11.849597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.864982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:11.865681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:11.866023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:11.866356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:11.867126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] RBAC: Adding query filter params (interface=public, service_id=1718141ff6b94a70bfe47708b79ac2c5, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:11.867668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:11.868954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:11.877779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 469/928] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/endpoints?service_id=1718141ff6b94a70bfe47708b79ac2c5&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:11.882728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:11.966580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d6c3-34dc-43e1-9fc0-09a1d47737e6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.002106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.002805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.003175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.003540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.014694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.017035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.019908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a18890-ed59-4b0f-a2c2-300edf5acad1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.021829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:12.033518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:12.034662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:12.035744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:12.035744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:12.035744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:12.041712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 460/929] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:12.042606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:12.064265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:12.071990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.072744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.072952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.073159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.073766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.075126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.081839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 470/930] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:11 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:48:12.165299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3376-57a7-4bf9-8a7e-4e3da599e40e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.206442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.207076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.207354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.207625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.208298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:12.208606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.210028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.224977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 461/931] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:12.230414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:12.340763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0daeb0-ae48-48df-bca8-98541143e09e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.376600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.377305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.377579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.377846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.385576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.387007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:12.402792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:12.403792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:12.405953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 471/932] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:12.410530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:12.494935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:12.519479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6b1be-e20d-4962-95e1-187ff2454a63 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.560258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.561253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.561743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.562206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.563274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:12.563784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.565537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee169f5-f149-4e1b-8528-1db67ff0af5f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.584448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 462/933] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:12.590286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:12.633166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:12.705818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5ff-bcfa-4f31-b6fa-2a8d626ea33a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.732765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc93cb-7573-4dc4-8a7f-c859a7156b43 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.733387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc93cb-7573-4dc4-8a7f-c859a7156b43 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.733669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc93cb-7573-4dc4-8a7f-c859a7156b43 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.736293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 463/934] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:12.741656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.741942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.742214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.744356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.745295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.745823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.746243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.757658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.759380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.761443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:12.762731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:12.774894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:12.776057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:12.777185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:12.777185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:12.777185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:12.778906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 472/935] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:12.794011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:12.842052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 464/936] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:12.887236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:12.912132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4983b6-654f-494a-a794-8ed12967110c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:12.949181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:12.950022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:12.950500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:12.950926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:12.951713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:12.952163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:12.954347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:12.967072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 473/937] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:12.973483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.043493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:13.082373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a968bcd-6f4b-48d7-9943-2c6311aecfbe None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.119613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.119801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.120358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.120638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.120966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.130348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.131852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:13.147000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:13.147882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:13.153517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 465/938] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:13.155738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.233125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce03a5-6641-4946-bb9f-34aeab0e236d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.273759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.275501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.276239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.276833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.277682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.279282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.286947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054abb0-89c9-407a-9aaf-051606163c15 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:13.291113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:13.292046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:48:13.292966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:13.296148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 474/939] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 06:48:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:13.302772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.306852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:13.322687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:13.341459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.342847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.343390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.343809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.344785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:13.345248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.347918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.364993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 466/940] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:13.370422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.429776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27155bc-46c3-4d74-8c38-bac3645a97a6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.470751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.471801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.472951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.473426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.474717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:13.475238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.477970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.485088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 475/941] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:13.490364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.499479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4960a5-3648-44ff-ab5b-855d682f504b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.536651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.537465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.537808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.538125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/5478fe7a36ca488e97019de5ae467f7e/roles/1960f938850b4b85958456734206956c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.540661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=5478fe7a36ca488e97019de5ae467f7e, role_id=1960f938850b4b85958456734206956c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.541850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.572608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 467/942] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:48:13 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/5478fe7a36ca488e97019de5ae467f7e/roles/1960f938850b4b85958456734206956c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:48:13.573680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:13.616774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0838f9-1dad-4ab5-beca-5d8ad76166b0 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.655918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.657204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.657411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.657691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.658390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:13.658698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.660190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e631e-4f82-4528-a925-4a022b7d45fe None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.667978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 476/943] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:13.673350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:13.728904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:13.799379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaaceb-125d-4d51-8018-db4cc554a472 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:13.837220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:13.837985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.838358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.838729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.839513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:13.841034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:13.854048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da58c-5dab-43cc-bad6-d7d0300b15a7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.854331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da58c-5dab-43cc-bad6-d7d0300b15a7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.854608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da58c-5dab-43cc-bad6-d7d0300b15a7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.855956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 477/944] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:13.862389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:13.862674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:13.862948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:13.865056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 468/945] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:13.888180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:13.889496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:13.976471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 478/946] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:14.259842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:14.371217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70f23f-bf10-4427-9b9b-67b466459044 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:14.373400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:14.409096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:14.409698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:14.409972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:14.410238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:14.410890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:14.412308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:14.414907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING keystone.server.flask.common [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 06:48:14.434529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.sql.core [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:48:14.434529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 06:48:14.434529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [parameters: {'id': '41e985076b234d0d9a986c16276ccd32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 06:48:14.434529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0a7cd5c5-41c1-4454-8bd9-7e706a982c24 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 41e985076b234d0d9a986c16276ccd32.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 41e985076b234d0d9a986c16276ccd32. Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:48:14.452158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 06:48:14.453207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application yield resource Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise self.value Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application session.commit() Sep 13 06:48:14.454190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:48:14.455063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:48:14.455997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:48:14.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [parameters: {'id': '41e985076b234d0d9a986c16276ccd32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:14.462974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:14.464751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 41e985076b234d0d9a986c16276ccd32. Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:14.466928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 469/947] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 13 06:48:14 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:14.468249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:14.475963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677cd88-6f6c-4bb4-a50d-d6e50500d0f7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:14.475963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677cd88-6f6c-4bb4-a50d-d6e50500d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:14.475963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677cd88-6f6c-4bb4-a50d-d6e50500d0f7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:14.484681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 470/948] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:14.487702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:14.488207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:14.488768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:14.510060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:14.512405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:14.519594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:14.566016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73e74e-a828-4725-91df-7e34b25e7ae5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:14.604931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:14.605569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:14.605848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:14.606118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:14.616619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 471/949] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:14.618069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:14.619741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:14.632389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:14.633497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:14.634609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:14.636630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 479/950] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:14.646544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:14.737417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:14.749381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b85a3d-4b76-4146-b574-33f541924031 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:14.785557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:14.786186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:14.786464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:14.786731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:14.787416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:14.787715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:14.789442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:14.816732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 472/951] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:14.910066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:15.029364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9bc04-1b05-491f-9030-67daccafd04a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:15.048690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:15.069364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:15.069686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.069960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.070226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.070800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:15.072170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:15.085201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:15.086192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:15.087851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 480/952] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:15.092402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:15.197641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fbf66-c1db-46c9-9e15-7c52be3f941b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:15.233199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:15.234159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.234891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.235362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.236201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:15.236736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:15.238299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:15.243699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 473/953] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:15.249239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:15.354311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aacf5c-cd32-45a9-834c-2b281efae686 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:15.388985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:15.389952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.390457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.391061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.391883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:15.392376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:15.393968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce666e-2420-43ba-b855-cbd119afe7ed None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:15.399558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 481/954] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:15.405714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:15.421288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:15.513444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6ebe-5649-4de7-9552-9f6287b4114f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:15.550782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:15.551790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.552524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.553129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.553996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:15.555553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70e1a3-d91e-44b9-9388-030b60260a99 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:15.578787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 474/955] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:15.917376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195aa65-6c15-4190-a596-ef0e8954a08f None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.917902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195aa65-6c15-4190-a596-ef0e8954a08f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.917902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195aa65-6c15-4190-a596-ef0e8954a08f None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.919429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 482/956] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:15.924853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aab8e-7e1f-453e-a891-cdd67616019c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:15.925362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aab8e-7e1f-453e-a891-cdd67616019c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:15.925847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aab8e-7e1f-453e-a891-cdd67616019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:15.945541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1b3aab8e-7e1f-453e-a891-cdd67616019c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:15.947073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1b3aab8e-7e1f-453e-a891-cdd67616019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:16.027085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.039491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 475/957] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:16.083246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0092-f6fd-4dd0-94c6-6d54f152e328 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.083557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0092-f6fd-4dd0-94c6-6d54f152e328 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.083795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c0092-f6fd-4dd0-94c6-6d54f152e328 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.085418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 483/958] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:16.090683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.090968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.091239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.110021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:16.111192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:16.178872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 476/959] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:16.319256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c0092-f6fd-4dd0-94c6-6d54f152e328 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.367203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.425763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c0092-f6fd-4dd0-94c6-6d54f152e328 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.461096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.461647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.461922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.462187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.464375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.474315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:16.480148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:16.481146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:16.482014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 484/960] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:16.488245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.591117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13549e-39ad-4961-be25-c0a66873b06c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.620356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa0f0-8477-496b-b449-04dac8f50351 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.623280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.626272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.638255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.639169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.639671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.640245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] PATH_INFO: `/v3/services/compute` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.641662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:16.643395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:16.653300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:16.654336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:16.655209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:16.658355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 477/961] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:16.664108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.667737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.668990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.672721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.673271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.674736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:16.675265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:16.677756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:16.694660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 485/962] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:16.696743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.779559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437672-872b-4b06-b70d-65831e6174be None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.818658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.819653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.820183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.820873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.821781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:16.822339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:16.824120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:16.827017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235871-4f85-4a8b-b701-7deda9bc1eb3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.834625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 478/963] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:16.835762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.868021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.868611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:16.868897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:16.869170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:16.881383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:16.882835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:16.897985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:16.898911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:16.899878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:16.900852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:16.900852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:16.900852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:16.904599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 486/964] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:16.906183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:16.929823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:16.960058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8ad2f-1a51-4e82-8a78-aa79d2cbb5cd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:16.998768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:16.999785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.000295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.000811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.001729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:17.002284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.003853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.016697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 479/965] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:17.021971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74f2e-657b-4f1e-996d-6c029b20152d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.060811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.061441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.061705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.061977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.062669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:17.062977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.064369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81170-cb80-4b24-aa66-f67a9eac6efd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.079131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 487/966] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:17.084809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.202716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e720f-9a73-4cda-929e-2c21892c0933 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.221140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:17.243843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.244489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.244811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.245143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.254181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.255622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:17.267712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:17.268761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.269782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 480/967] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:48:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:17.273818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4352ec-d6fa-4050-bbaa-e62d99c9de39 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.274036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4352ec-d6fa-4050-bbaa-e62d99c9de39 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.274283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4352ec-d6fa-4050-bbaa-e62d99c9de39 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.275013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.275872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 488/968] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:17.281766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.282163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.282538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.307847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:17.309171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:17.384146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a03b8-d5fb-45bb-8ea8-1e54c55ab8da None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.390202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 489/969] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:17.421816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.423408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.423839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.424292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.425201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:17.425698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.427534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.446378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 481/970] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 06:48:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:17.451819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.462724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:17.554937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acb06-dc96-416a-ba02-b12b77d51ef9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.592963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.593487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.594333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.594607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.663865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.665413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.680891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:17.699640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.741431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:17.786359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 490/971] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:17.790230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.824099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2a2e-2fb3-4918-98a9-8b467e14f71e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.864368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.864919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.865833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.865833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.866113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.867526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.884906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.sql.core [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:48:17.884906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 06:48:17.884906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [parameters: {'user_id': '551b2772251642b39d8242d1e7955733', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 06:48:17.884906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-2cc5bc5f-6aaa-4d96-91d9-f905f5b879f2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Sep 13 06:48:17.891554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:48:17.892495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application yield resource Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise self.value Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application session.commit() Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:48:17.893563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:48:17.894486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:48:17.895483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:48:17.896391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [parameters: {'user_id': '551b2772251642b39d8242d1e7955733', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:17.897262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 06:48:17.899123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 482/972] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 06:48:17 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422410-46b2-4378-b0e7-5ea801d56646 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422410-46b2-4378-b0e7-5ea801d56646 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.901509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422410-46b2-4378-b0e7-5ea801d56646 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.903828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ffc16-3ed5-4a04-968c-6adc1adb12f5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:17.909225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 483/973] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:17.909225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48422410-46b2-4378-b0e7-5ea801d56646 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:17.916350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:17.948427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:17.949218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.949361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.949594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:17.961692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:17.963142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-bad63230-ff2a-4c62-85d6-03552091cbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:17.978862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:17.979833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 491/974] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:17.986997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.002189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:18.003416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:18.033909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.041942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48422410-46b2-4378-b0e7-5ea801d56646 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.079313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.079927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.080200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.080470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.088647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 492/975] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:18.088647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.088861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.089552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:18.101990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:18.103183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:48:18.104411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:18.109593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 484/976] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:48:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:18.110971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.204442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.213408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bca11-3a73-4717-836c-bf44ed3cbe2b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.217364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d8fa1-749c-41f6-ac34-4271b9f519a1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.253472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.254098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.254374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.254641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.255277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.255574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.256962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.261425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.262275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.262779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.263262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.264748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.265280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.268084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.269291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 493/977] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:18.274901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.317993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 485/978] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:18.377911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.395729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.397707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288fa2-160b-471b-a611-022bd0fe9cc9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.435329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.435973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.436248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.436512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.444610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.446090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:18.458504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:18.459642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:18.460753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:18.464635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 494/979] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:18.465994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.479921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.503319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b153-c996-40ed-ae9b-cece2af24c03 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.555755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.556401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.557531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.557531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.557699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.559090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:18.568778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:18.570019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:18.571056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:18.573536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 486/980] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:18.582631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.583534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cfbe3-8bba-49db-897d-32a64183efbd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.628858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.629479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.629775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.630296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.631707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.631707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.632776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.647416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 495/981] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:18.653245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.689818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.713828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c420-849a-48dc-a983-831b1506bb73 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.730723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:18.749962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.750620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.750898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.751168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.751796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.752098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.753496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.758318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 487/982] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:18.763818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:18.764174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0cd2-35d6-4c44-b457-756d1fbb8f12 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.800383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.801032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.801312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.801568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.802541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] RBAC: Adding query filter params (role.id=1960f938850b4b85958456734206956c, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=5478fe7a36ca488e97019de5ae467f7e) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.802844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.804255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.810635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 496/983] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/role_assignments?user.id=5478fe7a36ca488e97019de5ae467f7e&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=1960f938850b4b85958456734206956c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:18.877778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c600c95-82b6-421d-86f7-588845a537d5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:18.914990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:18.915681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:18.915963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:18.916296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:18.917021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:18.917341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:18.918738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:18.925611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 488/984] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:18.931727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:19.050011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dd1ea-6401-441a-916d-326f7a7ccb5a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:19.084150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:19.084785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:19.085058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:19.085323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:19.086025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] RBAC: Adding query filter params (interface=admin, service_id=1718141ff6b94a70bfe47708b79ac2c5, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:19.086330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:19.087680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c6745-0cf0-4799-aff8-bdb9e99a5756 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:19.089320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:19.098668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 497/985] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Sep 13 06:48:18 2022] GET /identity/v3/endpoints?service_id=1718141ff6b94a70bfe47708b79ac2c5&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:19.099909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:19.109260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:19.203848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a70f-9341-4cd5-919c-1e5a5cce8bd7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:19.237799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:19.238501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:19.238837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:19.239170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:19.239834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:19.241283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a330-0094-40c6-942d-fadbb6bb8f4c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:19.252619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 489/986] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:19 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:48:19.394177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c15a-0aca-4913-8b37-10b2e6d0d5fb None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:19.394355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c15a-0aca-4913-8b37-10b2e6d0d5fb None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:19.394629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c15a-0aca-4913-8b37-10b2e6d0d5fb None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:19.396212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 498/987] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:19.401793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84c83-de89-49fc-a4c1-a2a8d66afe2a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:19.402082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84c83-de89-49fc-a4c1-a2a8d66afe2a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:19.402358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84c83-de89-49fc-a4c1-a2a8d66afe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:19.422996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4cd84c83-de89-49fc-a4c1-a2a8d66afe2a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:19.424533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4cd84c83-de89-49fc-a4c1-a2a8d66afe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:19.492730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:19.504634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 490/988] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:19.776152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c15a-0aca-4913-8b37-10b2e6d0d5fb None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:19.879414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c15a-0aca-4913-8b37-10b2e6d0d5fb None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:19.913771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:19.914373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:19.914656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:19.914928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:19.915584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:19.916973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4058-2537-48e0-96a6-41af6add52d9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:19.933625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 499/989] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:19 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:21.039667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3a98-9b9b-4977-987f-c176a63ef7dc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.040171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3a98-9b9b-4977-987f-c176a63ef7dc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.040282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3a98-9b9b-4977-987f-c176a63ef7dc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.041719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 491/990] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:21.046681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3468c-c13a-4545-b640-32c75d6171ea None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.047326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3468c-c13a-4545-b640-32c75d6171ea None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.047326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3468c-c13a-4545-b640-32c75d6171ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.066406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c8b3468c-c13a-4545-b640-32c75d6171ea None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:21.067579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c8b3468c-c13a-4545-b640-32c75d6171ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:21.121606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:21.145280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 500/991] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:21.409275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3a98-9b9b-4977-987f-c176a63ef7dc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:21.512143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a879e8-ad66-4257-8d43-35ede5a12335 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.512429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a879e8-ad66-4257-8d43-35ede5a12335 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.512736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a879e8-ad66-4257-8d43-35ede5a12335 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.514224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 501/992] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:21.517710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3a98-9b9b-4977-987f-c176a63ef7dc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:21.519663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.519953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.520231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.538692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:21.539876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:21.556331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:21.556998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.557270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.557590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] PATH_INFO: `/v3/services/image` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.558174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:21.559522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:21.570073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:21.571106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:21.572705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 492/993] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 06:48:21 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:21.576941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:21.616856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 502/994] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:21.653406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:21.694339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb08916-19be-45db-9c20-14868e5a6e81 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:21.729739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:21.730400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.730685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.730954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.731577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] RBAC: Adding query filter params (name=image) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:21.731871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:21.733248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:21.742546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 493/995] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:21.743758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:21.845457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494c8e-15ea-473d-b27c-fdf7baa93b5e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:21.859397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:21.881187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:21.881793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:21.882074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:21.882343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:21.882967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] RBAC: Adding query filter params (type=image) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:21.883267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:21.884656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:21.893564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 503/996] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:21.893732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.007286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8753-800a-4750-8e6f-b78b73877f96 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.046092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:22.057195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.057843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.058127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.058401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.058991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.060358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a009c5a8-99ba-465f-871e-b03c528e76b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:22.070537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:22.071539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.072385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 494/997] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 06:48:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:22.078514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.119592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c714c97-e051-4519-adfc-4b4d34324475 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.119914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c714c97-e051-4519-adfc-4b4d34324475 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.120515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c714c97-e051-4519-adfc-4b4d34324475 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.121629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 495/998] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:22.126568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.126851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.127126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.146051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:22.147244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:22.190405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8079-b1b6-4c9a-90d0-24cc05949d35 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.222883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 496/999] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:22.225601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.226207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.226480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.226744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.227365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:22.227658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.229041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.239146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 504/1000] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:22.240206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.341719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124db8ae-e9a0-4ca3-a4e0-6cca6f8495c7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.364109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:22.378924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.379543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.379822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.380149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.380818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:22.381121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.382491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.392718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 497/1001] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:22.393735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.437450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:22.494501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.495650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de261b7-e3a5-496f-8836-b09a58dca645 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.533610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.534215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.534488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.534753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.535841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.537282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.556812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 505/1002] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:22.607988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15732a-6668-42d7-87a1-b953b7de8ebb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.654246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.654891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.655176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.655445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.656031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.657487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:22.667173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:22.668234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:22.673482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 498/1003] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:22.675607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.785863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe38c68-42ce-4b9c-a1be-2cc8b76439c6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.787626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:22.823115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.823718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.823990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.824258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.824911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:22.825209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.826560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.831693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 506/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:22.837145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:22.887365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:22.943043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a502ab-370e-4a2a-b5f7-9e57aa7babd6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:22.976953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:22.977551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:22.977822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:22.978098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:22.978700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:22.978994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:22.980345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:22.990632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 499/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:22.991954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:23.105799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345765a3-52c3-439c-aa9c-38e7abb3aa4f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:23.139887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:23.140411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:23.140876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:23.141160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:23.141860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] RBAC: Adding query filter params (interface=public, service_id=abcf1a985dc74bfd8de0777c7e8774b0, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:23.142168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:23.143534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021744-a7ed-4828-86fc-2893e40d0b2f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:23.153196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 507/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:48:22 2022] GET /identity/v3/endpoints?service_id=abcf1a985dc74bfd8de0777c7e8774b0&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:23.154286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:23.257506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c15c-8ee7-4bcf-9d28-0c975f99b34e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:23.268251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:23.292639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:23.293250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:23.293524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:23.293790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:23.294388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:23.295739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184e7eb-83ac-4c59-9c47-07a00e33ff32 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:23.308623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 500/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:23 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:48:24.081938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea272-b180-45fb-8ae7-d97958a01d04 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:24.082267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea272-b180-45fb-8ae7-d97958a01d04 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:24.082494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea272-b180-45fb-8ae7-d97958a01d04 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:24.083960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 508/1008] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:24.089116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba045-77d9-4dc3-a1ca-1ff948537f30 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:24.089403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba045-77d9-4dc3-a1ca-1ff948537f30 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:24.089673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ba045-77d9-4dc3-a1ca-1ff948537f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:24.107392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5f2ba045-77d9-4dc3-a1ca-1ff948537f30 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:24.108558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5f2ba045-77d9-4dc3-a1ca-1ff948537f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:24.176961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 501/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:24.444438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea272-b180-45fb-8ae7-d97958a01d04 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:24.475484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:24.549424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea272-b180-45fb-8ae7-d97958a01d04 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:24.582681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:24.583291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:24.583568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:24.583838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:24.584495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:24.585912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ad77-4031-47bd-aa21-2f23c555dc5b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:24.601457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 509/1010] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:24 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:24.773821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe8c3-8c65-4cab-8817-09ec21a1c888 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:24.774156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe8c3-8c65-4cab-8817-09ec21a1c888 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:24.774379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe8c3-8c65-4cab-8817-09ec21a1c888 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:24.775893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 502/1011] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:24.781598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:24.781892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:24.782356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:24.801535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:24.803294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:24.880434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 510/1012] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:25.167435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe8c3-8c65-4cab-8817-09ec21a1c888 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:25.271567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe8c3-8c65-4cab-8817-09ec21a1c888 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:25.273888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:25.307741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:25.308371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:25.308672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:25.308944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:25.310041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:25.311459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34a5f6-cc5a-4e4a-a0ff-9e7946bf6583 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:25.313385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 503/1013] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:25.318878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:25.336404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:25.427611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba544-a8e5-4bc6-bde5-c10a7ed7178f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:25.462198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:25.462859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:25.463100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:25.463321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:25.463979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:25.465424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:25.484753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d8ea-b917-49e5-9d50-ddbddb25d237 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:25.485086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d8ea-b917-49e5-9d50-ddbddb25d237 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:25.485384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d8ea-b917-49e5-9d50-ddbddb25d237 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:25.487194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 504/1014] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:25.492190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:25.492479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:25.492782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:25.500416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 511/1015] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:25 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:25.512261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:25.513527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:25.595221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 505/1016] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:25.864488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:25.937136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:25.974931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abcdcf-08ad-48d9-9c35-1c2b0f3ff1bd None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:26.011897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:26.011897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.011897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.011897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.012315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:26.013063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:26.022610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:26.023638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:26.024484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 512/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:26.029694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:26.129856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8ddb-e788-4bd3-a670-8b0b2aaf6de6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:26.131273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:26.164428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:26.165059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.165331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.165596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.166214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] RBAC: Adding query filter params (name=compute) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:26.166511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:26.167866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:26.173321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 506/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:26.178968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:26.279961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85e3e-1ff3-49be-ad47-d3f8411858a5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:26.309073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:26.315700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:26.316303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.316599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.316883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.317511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:26.317807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:26.319163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f3bd9-9c48-4476-a641-79eb648a8e82 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:26.329249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 513/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 06:48:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:26.330662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:26.431076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ec53f-0dfd-41ad-958f-1ecc2e4886af None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:26.468280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:26.469530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.469804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.470070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.470740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:26.472084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07c145-1d82-40c6-9554-954bad2069b3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:26.500636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 507/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:48:26.896517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c80bd-195c-46b1-8b0c-507278b9d0f5 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.897108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c80bd-195c-46b1-8b0c-507278b9d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.897108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c80bd-195c-46b1-8b0c-507278b9d0f5 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.898552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 514/1021] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:26.903583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:26.903879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:26.904155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:26.924115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:26.925316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:26.943280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:27.004285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 508/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:27.284382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c80bd-195c-46b1-8b0c-507278b9d0f5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:27.395976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c80bd-195c-46b1-8b0c-507278b9d0f5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:27.431568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:27.432197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.432472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.432779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] PATH_INFO: `/v3/services/image` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.433356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:27.434777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:27.444021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:27.445219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:27.446062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:27.448917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 515/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 06:48:27 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:27.451043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:27.560778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93125d-6e2e-488f-a04a-ea10fb73e680 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:27.598051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:27.598662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.598937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.599204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.599827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:27.600124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:27.601504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9b965-f2d8-4513-8ad9-dec063d6bfc0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:27.611295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 509/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:27.612514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:27.677678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:27.719044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676164-0c6b-427f-a763-e5bc6721d29e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:27.752785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:27.753391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.753662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.753960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.754193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60459169-adb2-40a8-b28e-38f3dc1e60a1 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.754481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60459169-adb2-40a8-b28e-38f3dc1e60a1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.754582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:27.754754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60459169-adb2-40a8-b28e-38f3dc1e60a1 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.754863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:27.756226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 510/1025] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:27.756346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:27.766572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 516/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:27.766764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.766764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.766764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.767646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:27.784834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:27.785989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:27.793424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:27.856826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 511/1027] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:48:27.884739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b863e8-f3d7-479b-ac1d-f4413e8cf4f7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:27.909145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:27.921869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:27.922860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:27.923143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:27.923468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:27.924175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] RBAC: Adding query filter params (interface=public, service_id=b1d8e4f7be664c6c9a0359e0e757ee05, region_id=RegionOne) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:27.924483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:27.925928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:27.935601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 517/1028] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:48:27 2022] GET /identity/v3/endpoints?service_id=b1d8e4f7be664c6c9a0359e0e757ee05&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:27.937962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:28.041933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c92ce-3478-49d2-91f2-dc8098625573 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:28.076108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:28.076737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:28.077013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:28.077278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:28.077985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:28.079459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:28.092835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 512/1029] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:48:27 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:48:28.128937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:28.237958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f715c-5fc5-4060-8f4d-7e7b1859a160 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:28.273295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:28.273922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:28.274194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:28.274455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:28.275534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:28.276981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d4d4f-73e7-4225-840e-2ca6ab0b1518 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:28.278898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 518/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:28.285134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:28.295417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:28.390700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d139344-7897-45e1-a9e0-1ba5653f1e4a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:28.425652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:28.426275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:28.426553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:28.426825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:28.427734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:28.429210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12486309-ec43-471b-99cc-65efb5a98601 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:28.452216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 513/1031] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:48:28 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:48:28.822540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02092-8969-481b-8d18-838242fb7609 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:28.822933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02092-8969-481b-8d18-838242fb7609 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:28.823138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02092-8969-481b-8d18-838242fb7609 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:28.824465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 519/1032] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:28.830457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:28.830750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:28.831024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:28.851573 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:28.852783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:28.913620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:28.927140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 514/1033] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:29.208480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e02092-8969-481b-8d18-838242fb7609 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:29.268041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:29.314446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e02092-8969-481b-8d18-838242fb7609 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:29.353197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:29.353836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:29.354114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:29.354382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:29.365462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:29.370208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:29.371152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:29.373549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 520/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:29.377744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:29.483110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d24a0-94fe-4ae7-909d-9202663ae2f8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:29.524282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:29.524929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:29.525208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:29.525479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:29.526144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:29.526446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:29.527810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:29.540738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 515/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:29.542215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:29.643297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bca95-1e31-4701-95e8-e34cc5a7f4e8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:29.663838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:29.683657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:29.684288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:29.684562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:29.684859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:29.696257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:29.697763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:29.712832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:29.713836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:29.719654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:29.719654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:29.719654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:29.719654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 521/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:29.719914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:29.778881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:29.827904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f058f1-9e75-4977-97a8-fdadeeefe769 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:29.862761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:29.863368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:29.863647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:29.863975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:29.864727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:29.865033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:29.866480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:29.883562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 516/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:29.884380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:29.988635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905db886-8cfb-49df-bd4d-372558d518c2 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.030936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.032063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.032530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.032834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.040525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.041983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:30.053685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:30.054632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:30.055599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:30.056776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 522/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:48:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:30.060534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.167715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9c875-ef53-4800-8e2f-8d0b68926d42 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.184846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.209602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.210220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.210494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.210763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.211492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:30.211794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.213237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c33ce9-9b3f-4647-9bad-5ed3ea8b4a00 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.236435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 517/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:30.237785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.269271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.287454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb004f2-fc59-4a50-a9fc-46d65e24b624 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.287726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb004f2-fc59-4a50-a9fc-46d65e24b624 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.288266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb004f2-fc59-4a50-a9fc-46d65e24b624 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.290044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 518/1040] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:48:30.294920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.295206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.295476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.318890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:30.320087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:30.351254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd210e7-957e-44b6-ba92-800c8cb0a0ae None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.389905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.390496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.390773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.391042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.393898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 519/1041] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:30.463571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.465049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.492312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.566365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 523/1042] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:30.572058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.664850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.678181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842f8dd-1907-4bc9-8f99-4244cef4b68f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.679863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.715929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.716563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.716864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.717131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.730431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.731865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a762cbc1-fc1b-493c-9821-28b97d5b4781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:30.747170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:30.748285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:30.749225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:30.749225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:30.749225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:30.749225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 520/1043] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:30.749574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3c58-2db2-4ede-816c-cc663396823b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.750151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3c58-2db2-4ede-816c-cc663396823b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.750427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b3c58-2db2-4ede-816c-cc663396823b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.752334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 521/1044] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:30.753925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b3c58-2db2-4ede-816c-cc663396823b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.771546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fbcf-b487-46ab-b53d-34783bce50c4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.797755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:30.806045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.806670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.806949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.807224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.807807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.809202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f269e72f-7e57-46f0-9255-3f6f94681cc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:30.818562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:30.819861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:30.821048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 524/1045] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:30.821872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.821872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.821872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.839878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:30.841143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:30.859886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b3c58-2db2-4ede-816c-cc663396823b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:30.893107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:30.893711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:30.893989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:30.894258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:30.894897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:30.895203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:30.896601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:30.907086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 525/1046] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:30.907915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.913022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 522/1047] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:30.913711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:30.930614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.024338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9d547-d500-444b-b90c-1f313d0cab0c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.025846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d88e-35e8-44a2-9ee4-ccb0fdfb6f57 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.048419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.061666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.062794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.063133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.063461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.064034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] RBAC: Adding query filter params (name=image) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:31.064366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.064998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.065627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.065738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.065897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.066162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.070904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 526/1048] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:31.075039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.076350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.076609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:31.089846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:31.090772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:31.091822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 523/1049] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:31.097778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.177111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.182600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0cc0-003c-4c84-bfc8-091937b95186 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.203214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056b76-d3a5-49ee-b1e4-f96d55b9716f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.217606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.218210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.219107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.219383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.220125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] RBAC: Adding query filter params (type=image) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:31.220426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.221825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.226443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 527/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:31.227223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.239714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.240324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.240635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.240910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.241600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:31.241903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.243320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.255196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 524/1051] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:31.255958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.277527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.326894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9c2a-8b84-4029-905b-b0d2925e3925 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.355637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91730c14-21d0-4808-9d09-9cea8fa66ac4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.359850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.360470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.360775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.361042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.371010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:31.376398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:31.377611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 528/1052] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:31.378844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.396107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.396743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.397020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.397288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.397948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.399304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.403723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.420568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 525/1053] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:48:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:31.421398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.492347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45592c-ef88-47bc-aa33-b3abe889562c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.506088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.538294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a53ad-03e7-431a-bbc6-722d6e76d9d5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.541842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.542515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.542788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.543055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.543832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] RBAC: Adding query filter params (role.id=1960f938850b4b85958456734206956c, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:31.544138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.545618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.564615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 529/1054] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=1960f938850b4b85958456734206956c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:31.589760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.590321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.590675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.591022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.591792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:31.592171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.594372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.604772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 526/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:31.612182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.736807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772df542-11b4-4c86-a41f-74cd27c30516 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.792611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.792611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.792611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.792611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] PATH_INFO: `/v3/users/0f3803e365cd4af098d5168283582a03` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:31.812602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3803e365cd4af098d5168283582a03)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:31.812602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:31.818605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 530/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/users/0f3803e365cd4af098d5168283582a03 => generated 285 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:31.819875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:31.887973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:31.944868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2b4b5-1140-4410-9187-aa0aa5e7d9e6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:31.983640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:31.984821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:31.985093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:31.985355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:32.060817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:32.062400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:32.114312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:32.175199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 527/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:32.181009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:32.210852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:32.283873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050eb77-72af-4e8e-9fab-460dbe46b663 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:32.317712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:32.318335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:32.318608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:32.318873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:32.319963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:32.321408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1476-f95b-4352-8bb2-38c48da31c9e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:32.323179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 531/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:32 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:32.329197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:32.431116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0e43c-51f7-4cc1-9097-5de5bda22195 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:32.464442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:32.465068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:32.465346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:32.465611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:32.466322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=4c29aaa1cc824b2c86db0b6115e34549, user.id=0f3803e365cd4af098d5168283582a03) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:32.466625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:32.468041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657608-a17e-4dff-aa65-7f82ca002eb0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:32.474545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 528/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:32 2022] GET /identity/v3/role_assignments?user.id=0f3803e365cd4af098d5168283582a03&scope.project.id=4c29aaa1cc824b2c86db0b6115e34549&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:33.662479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5c25a-c8c0-4a1b-9bb5-96cbe9e8ed78 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:33.662993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5c25a-c8c0-4a1b-9bb5-96cbe9e8ed78 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:33.662993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5c25a-c8c0-4a1b-9bb5-96cbe9e8ed78 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:33.664360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 532/1060] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:33.669426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36846f-a294-47b4-8253-6fae73dba152 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:33.669822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36846f-a294-47b4-8253-6fae73dba152 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:33.670011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36846f-a294-47b4-8253-6fae73dba152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:33.692016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5b36846f-a294-47b4-8253-6fae73dba152 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:33.693362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5b36846f-a294-47b4-8253-6fae73dba152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:33.702245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:33.766070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 529/1061] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:33.804349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fbc24-3547-4c75-931e-3349892e3a31 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:33.804745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fbc24-3547-4c75-931e-3349892e3a31 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:33.805103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fbc24-3547-4c75-931e-3349892e3a31 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:33.808675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 533/1062] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:33.811620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:33.811988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:33.812379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:33.830127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:33.831273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:33.896777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 530/1063] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:34.036327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fbc24-3547-4c75-931e-3349892e3a31 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.132240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.140054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fbc24-3547-4c75-931e-3349892e3a31 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.167271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.181045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.181662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.181938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.182213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.246717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.254987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.256435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.279791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592d316-22b8-489b-ad7a-670cb456ad12 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.319844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.320835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.321330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.321666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.332518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:34.337473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:34.338468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:34.341734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 531/1064] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:34.344424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.358324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.369007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 534/1065] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:34.373855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.453496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92db9a1-f1ef-4371-8e09-f85821c4848c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.478329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84e1c9-dc92-40a7-9013-ed6516fd457b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.487986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.494671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.495655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.496126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.496395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.497186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:34.497436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.498914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.507871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 532/1066] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:34.514013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.520393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.521268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.521724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.522142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.533984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.535740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:34.551703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:34.553169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:34.554292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:34.554292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:34.554292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:34.555841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 535/1067] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:34.561617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.617606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.632075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97c707-3f37-445e-950f-10c6d6817f2a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.665935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.666588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.666859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.667125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.670760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33dc6-d667-43cc-830b-dc4f9bcb31d5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.677730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.679179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b8a44227-0285-4b33-9723-b589502574e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:34.693969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:34.695011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:34.695943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:34.695943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:34.695943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:34.695943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 533/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:34.696274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dafe0-f0cd-4999-ac08-39e5bf09758c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.696674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dafe0-f0cd-4999-ac08-39e5bf09758c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.696845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dafe0-f0cd-4999-ac08-39e5bf09758c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.698062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 534/1069] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:34.700626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dafe0-f0cd-4999-ac08-39e5bf09758c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.710866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.711469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.711740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.712005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.712670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:34.712968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.714316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199aa56-81f8-4f59-ae25-5ef3ba942ceb None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.726704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 536/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:34.727844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.728120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.728386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.747520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:34.748778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:34.765273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:34.829710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 537/1071] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:34.849554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dafe0-f0cd-4999-ac08-39e5bf09758c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:34.887801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:34.888544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:34.888877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:34.889150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:34.889800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:34.890104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:34.892145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:34.904886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 535/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:34.911293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:34.956426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.025703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd945e-10f7-4cab-b52b-d2b6448210db None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.065966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.066969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.067241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.067507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.074819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.076250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:35.087929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:35.088951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:35.089908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 538/1073] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:48:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:35.094909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.103192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.196078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97d7c-ad27-4e8b-8aab-4ee719fa1b73 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.201808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.204224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.206362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e94b-aa91-46b6-b070-75e2715fa832 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.232303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.232937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.233217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.233487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.234711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:35.235011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.236433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.240560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.241209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.241487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.241758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.253047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:35.254356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 536/1074] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:35.257880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:35.260322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:48:35.261377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 539/1075] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:35.262082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.264863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.361176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca508-352e-48f7-b665-2476d5775899 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.364885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63205121-d71d-41e8-9c69-ba02c7d9b555 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.394023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.394649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.394928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.395198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.397003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.397587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.397866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.398124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.398771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:35.399064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.400407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.407301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.409441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.414095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 540/1076] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:35.419895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:35.425600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:35.426887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:35.428449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:35.428449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:35.428449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:35.428449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 537/1077] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:35.432277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.447308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.451588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.527109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cec9-d4cc-4bb4-af23-d3d7e64b3f77 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.530436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28d20-db89-4898-83c1-6faf70a89a95 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.560560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.561204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.561476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.561741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] PATH_INFO: `/v3/users/0f3803e365cd4af098d5168283582a03` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.563381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3803e365cd4af098d5168283582a03)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.564762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.564898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.565354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.565627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.565893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.566378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 541/1078] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/users/0f3803e365cd4af098d5168283582a03 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:35.566524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:35.566811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.568177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.571986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.581055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 538/1079] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:35.586584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.659946 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.661206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.673220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406da0ff-e4d0-4f26-b255-ef3b0c0b0da4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.684326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5733d0-aec4-4a99-906f-f78f784fd955 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.706936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.707556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.707829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.708098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.709293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.710904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.712886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 542/1080] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:35.718817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.719139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.719532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.719810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.720077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.726701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.728132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:35.739695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:35.740666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:35.741590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 539/1081] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:35.746513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.819887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f47c-6ecf-423f-ac60-72c41fa1eb55 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.845919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fee50f-45da-4abb-b08d-6ee01cb3b8fe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:35.853242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.853887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.854160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.854431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549/users/0f3803e365cd4af098d5168283582a03/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.859884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c29aaa1cc824b2c86db0b6115e34549, user_id=0f3803e365cd4af098d5168283582a03, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.861936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.877578 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 543/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:48:35 2022] PUT /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549/users/0f3803e365cd4af098d5168283582a03/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:48:35.885240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:35.885991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:35.886343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:35.886684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:35.887466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:35.887852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:35.889375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f71a8-bf2d-43d8-a4f2-8c94da83f220 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:35.892795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:35.903512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 540/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:35.910088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:35.930250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:36.021013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116829-e8b3-499d-814d-a20ee516c111 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:36.057061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:36.057721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:36.057997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:36.058263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/1960f938850b4b85958456734206956c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:36.060422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=b732fb0cfa4749c3a1e96639ff69e9f1, role_id=1960f938850b4b85958456734206956c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:36.061917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42d091-1987-4add-96c0-068f8162c763 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:36.075790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 544/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:48:35 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/b732fb0cfa4749c3a1e96639ff69e9f1/roles/1960f938850b4b85958456734206956c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:48:38.033875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530d77-a7cd-4cb0-98e7-b3f6b842faf3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.034329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530d77-a7cd-4cb0-98e7-b3f6b842faf3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.034409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530d77-a7cd-4cb0-98e7-b3f6b842faf3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.035752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 541/1085] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:38.041148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519e5d-1928-4a9c-8983-f5c2b4d86eac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.041579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519e5d-1928-4a9c-8983-f5c2b4d86eac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.041682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519e5d-1928-4a9c-8983-f5c2b4d86eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.059797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e6519e5d-1928-4a9c-8983-f5c2b4d86eac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:38.061003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e6519e5d-1928-4a9c-8983-f5c2b4d86eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:38.131492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 545/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:38.206697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f3f9-90c1-43ca-9cde-947dc8ea0e95 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.206979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f3f9-90c1-43ca-9cde-947dc8ea0e95 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.207253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f3f9-90c1-43ca-9cde-947dc8ea0e95 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.208571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 542/1087] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:38.213644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.213937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.214213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.227215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:38.233667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:38.235106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:38.300500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 546/1088] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:38.397624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f3f9-90c1-43ca-9cde-947dc8ea0e95 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.498997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f3f9-90c1-43ca-9cde-947dc8ea0e95 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.532626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.533247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.533525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.533796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.543737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:38.548696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:38.549822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:38.550727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 543/1089] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:48:38.556013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.570543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.627396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:38.659335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94a75-bab5-424e-bd53-93fc3321fb56 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.670581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86f5b-6d19-49d2-98c0-eff0a6a75312 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.693446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.694061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.694339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.694605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.695267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:38.695563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:38.696956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:38.700915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:38.708328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.708990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.709265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.709534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.710088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 547/1090] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:38.715976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.720042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:48:38.724818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:38.725946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:38.727300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 544/1091] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:38.731602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.814801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ea8dc-18be-43d9-9484-cc001dcd2ec8 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.831688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925501c-001d-4ff7-9858-a368b7231927 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.847575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:38.848223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.848659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.848980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.849283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] PATH_INFO: `/v3/users/0f3803e365cd4af098d5168283582a03` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.850563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] RBAC: Authorizing `identity:get_user(user_id=0f3803e365cd4af098d5168283582a03)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:38.851980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:38.853571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 548/1092] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/users/0f3803e365cd4af098d5168283582a03 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:38.859867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.866224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.866826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.867099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.867366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:38.868020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:38.868315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:38.869710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:38.877969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 545/1093] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:38.883660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:38.924534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:38.959882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57fff-0128-4a31-b565-19f1e258a88f None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.982885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd053-091b-4970-aa3c-9f65803d220f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:38.993315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:38.993920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:38.994199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:38.994472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.019147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.019784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.020065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.020337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.031283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.032754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:39.047142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:39.048741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:39.049829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:39.049829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:39.049829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:39.049829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 546/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:39.054220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.070682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.072066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.084937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.137378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.157159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf38e2d-e1d5-416b-b168-f46317f8530d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.172592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 549/1095] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:48:39.178863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.192554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.193183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.193463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.193734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.194371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:39.194738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.196039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.208204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 547/1096] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:39.213589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.282812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8910-938e-4b4f-b362-a2bf21a08253 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.302063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.312701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4082c-f2a2-485f-9157-19cfb9ec21d7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.317378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.317998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.318271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.318537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.319635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.321145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.322701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 550/1097] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:39.328975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.350242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.350866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.351138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.351405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.358443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.360075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.361740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:48:39.372322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:39.373527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:39.375283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 548/1098] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:39.379675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.428586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187617-64df-4c5e-bac5-4af89e9b430d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.461678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.462274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.462557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.462827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.463543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=4c29aaa1cc824b2c86db0b6115e34549, user.id=0f3803e365cd4af098d5168283582a03) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:39.463848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.465296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.471801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 551/1099] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/role_assignments?user.id=0f3803e365cd4af098d5168283582a03&scope.project.id=4c29aaa1cc824b2c86db0b6115e34549&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:39.479177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e2bf-aa55-4cf0-8d2d-029a4a31d306 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.517293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.517912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.518188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.518454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.519227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:39.519518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.520987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.541257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 549/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:48:39.547431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.648041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.652338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc153-7c05-46b6-a62f-5f239239a5f6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.687767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.688376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.688718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.688996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:39.754664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:39.756098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:39.847071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.851625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 552/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:39.857345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:39.869220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:39.960176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb8ceb-eb8b-4b56-b44b-058780933118 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:39.995165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:39.995798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:39.996074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:39.996342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:40.006892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:40.008323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:48:40.029349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:40.030350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:48:40.031768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:48:40.031768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:48:40.031768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:40.031768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 550/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:40.036607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:40.132694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df9cb-138b-49a1-9fba-af27c7785201 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:40.165649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:40.166256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:40.166535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:40.166808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:40.167453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:40.167754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:40.169160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:40.181135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 553/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:40.187616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:40.246980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:40.287738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e6de0-22b6-464f-94cc-d792fb1de24b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:40.320508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:40.321152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:40.321423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:40.321686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:40.328963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:40.330378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:48:40.341182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:48:40.342126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:48:40.343048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 551/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:48:40.348346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:40.406644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:40.447620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bb87-23eb-4d16-8e6f-a6599b5f9993 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:40.479156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:40.479743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:40.480016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:40.480281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:40.480987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:40.481285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:40.482687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c8bc7-5950-4d0e-8820-c826647057b0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:40.495155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 554/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:40.501865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:40.602265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85777071-ebc0-4a81-8d70-430013231c4e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:40.622418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:40.637201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:40.637838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:40.638119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:40.638387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:40.639107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] RBAC: Adding query filter params (role.id=1960f938850b4b85958456734206956c, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=b732fb0cfa4749c3a1e96639ff69e9f1) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:40.639414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:40.641359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acf9f9-46d2-42aa-8fe0-6c3d97545fe0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:40.646999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 552/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:40 2022] GET /identity/v3/role_assignments?user.id=b732fb0cfa4749c3a1e96639ff69e9f1&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=1960f938850b4b85958456734206956c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:41.682843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128511fe-264e-4f2b-b399-3ebf43b94369 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:41.683482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128511fe-264e-4f2b-b399-3ebf43b94369 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:41.683482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128511fe-264e-4f2b-b399-3ebf43b94369 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:41.684753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 555/1107] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:41.690740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:41.691182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:41.691387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:41.709812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:41.710981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:41.776085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 553/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:42.044285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128511fe-264e-4f2b-b399-3ebf43b94369 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:42.141914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128511fe-264e-4f2b-b399-3ebf43b94369 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:42.158059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:42.174350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:42.174956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:42.175228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:42.175492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:42.176567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:42.178253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28733e99-5c06-4936-9c11-2487b4dcfec5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:42.180034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 556/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:42.185833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:42.281206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd6d0-0766-4c6e-bda8-40462a8feb51 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:42.294800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:42.316491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:42.317114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:42.317387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:42.317653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:42.318289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:42.319692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b490113-3e36-4e8e-b2e1-d3adbd04af67 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:42.340912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 554/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:48:42 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:44.501686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300264c-7fa5-48f7-a117-a0335657d6d0 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:44.502231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300264c-7fa5-48f7-a117-a0335657d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:44.502511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300264c-7fa5-48f7-a117-a0335657d6d0 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:44.503852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 557/1111] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:44.509021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:44.509451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:44.509562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:44.527698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:44.528884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:44.592634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 555/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:44.863480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300264c-7fa5-48f7-a117-a0335657d6d0 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:44.961125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300264c-7fa5-48f7-a117-a0335657d6d0 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:44.993039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:44.993647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:44.993919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:44.994183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] PATH_INFO: `/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:44.995524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] RBAC: Authorizing `identity:get_role(role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:44.996898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:44.998166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 558/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:44 2022] GET /identity/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:45.004555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:45.103116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:45.105930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd90c5b-86ea-483e-866a-c99d643622c1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:45.139640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:45.140314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:45.140613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:45.140892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] PATH_INFO: `/v3/users/5a4256d12d4d44928bda1d566452f85b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:45.153475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] RBAC: Authorizing `identity:get_user(user_id=5a4256d12d4d44928bda1d566452f85b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:45.154906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:45.157149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 556/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:45 2022] GET /identity/v3/users/5a4256d12d4d44928bda1d566452f85b => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:45.162980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:45.216030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:45.259902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bfe43-9f2e-41b5-8eff-f9966d5e420e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:45.292304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:45.292933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:45.293212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:45.293484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:45.360736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:45.362171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:45.413644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:45.457425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 559/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:45.463370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:45.563662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484050d-aad2-47fb-9b33-2207a4d0360f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:45.599951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:45.600566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:45.600874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:45.601141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:45.602232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:45.603647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5e946-a161-4fb5-af52-9e3fcc8dcfee None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:45.605280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 557/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:45 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:45.611859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:45.706637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c7fb-dca4-4901-814e-3adfd1d3ade7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:45.739175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:45.739763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:45.740040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:45.740311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:45.741056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=4c29aaa1cc824b2c86db0b6115e34549, user.id=5a4256d12d4d44928bda1d566452f85b) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:45.741363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:45.742779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1d8ae-5d06-452e-a377-92b8773cadbf None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:45.747938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 560/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:45 2022] GET /identity/v3/role_assignments?user.id=5a4256d12d4d44928bda1d566452f85b&scope.project.id=4c29aaa1cc824b2c86db0b6115e34549&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:47.852847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd34d-eb83-4898-af11-8e177f88b53f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:47.853399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd34d-eb83-4898-af11-8e177f88b53f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:47.853399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd34d-eb83-4898-af11-8e177f88b53f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:47.854730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 558/1118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:47.860391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:47.860818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:47.860966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:47.879228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:47.880407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:47.893272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:47.947196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 561/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:48.214692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dd34d-eb83-4898-af11-8e177f88b53f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:48.242931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:48.315810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dd34d-eb83-4898-af11-8e177f88b53f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:48.348814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:48.349429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:48.349702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:48.349975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] PATH_INFO: `/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:48.351337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] RBAC: Authorizing `identity:get_role(role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:48.352718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:48.354010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 559/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:48 2022] GET /identity/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:48.360680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:48.456354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571a16-6a94-4f2e-9ebd-5a7dbd6856df None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:48.489659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:48.490281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:48.490557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:48.490826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] PATH_INFO: `/v3/users/5a4256d12d4d44928bda1d566452f85b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:48.491925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5a4256d12d4d44928bda1d566452f85b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:48.493374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:48.494925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 562/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:48 2022] GET /identity/v3/users/5a4256d12d4d44928bda1d566452f85b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:48.501622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:48.601025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:48.607859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53ea7-3129-4efd-b559-764b618bf081 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:48.641956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:48.642571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:48.642848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:48.643117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:48.644198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:48.645649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd4a8-a31f-4c2e-9759-4ed40761fad3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:48.647239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 560/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:48 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:48.653180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:48.670799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:48.749138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd8b33-fd93-4a4d-a76e-865a4a2448b5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:48.781004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:48.781636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:48.781909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:48.782181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549/users/5a4256d12d4d44928bda1d566452f85b/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:48.784260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c29aaa1cc824b2c86db0b6115e34549, user_id=5a4256d12d4d44928bda1d566452f85b, role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:48.785700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be5e23-7652-4ead-8c7b-4e6a80bbce19 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:48.798263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 563/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:48:48 2022] PUT /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549/users/5a4256d12d4d44928bda1d566452f85b/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:48:50.927142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf8c9-ee10-4a50-9c12-06213b78d8e5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:50.927955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf8c9-ee10-4a50-9c12-06213b78d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:50.927955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcf8c9-ee10-4a50-9c12-06213b78d8e5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:50.929293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 561/1124] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:50.934580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:50.934951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:50.935133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:50.953530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:50.954715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:51.019274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 564/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:51.291330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcf8c9-ee10-4a50-9c12-06213b78d8e5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:51.388924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcf8c9-ee10-4a50-9c12-06213b78d8e5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:51.421425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:51.422038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:51.422312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:51.422577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] PATH_INFO: `/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:51.423940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] RBAC: Authorizing `identity:get_role(role_id=4594ed7f7a2a46e0ac3c6b0740bda66e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:51.425326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:51.426608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 562/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:51 2022] GET /identity/v3/roles/4594ed7f7a2a46e0ac3c6b0740bda66e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:51.432690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:51.441114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:51.531130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37bc57-b6d4-45fd-9bb2-73635f5e4b15 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:51.567975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:51.568532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:51.568845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:51.569119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] PATH_INFO: `/v3/users/5a4256d12d4d44928bda1d566452f85b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:51.570242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] RBAC: Authorizing `identity:get_user(user_id=5a4256d12d4d44928bda1d566452f85b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:51.571934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:51.573761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 565/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:48:51 2022] GET /identity/v3/users/5a4256d12d4d44928bda1d566452f85b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:51.580126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:51.610055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:51.683734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a740-f81b-46e5-998d-91e313abaa56 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:51.719200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624f41-707f-4bca-8d24-898be255428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:51.719796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624f41-707f-4bca-8d24-898be255428b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:51.720074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624f41-707f-4bca-8d24-898be255428b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:51.720340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624f41-707f-4bca-8d24-898be255428b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:51.789867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624f41-707f-4bca-8d24-898be255428b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:51.791306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624f41-707f-4bca-8d24-898be255428b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:51.828298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:51.913603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 563/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:48:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:48:51.919584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:52.005431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:52.031457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be7b1-1536-4424-a008-bf7b186a2641 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:52.066072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:52.066699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:52.066976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:52.067245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] PATH_INFO: `/v3/projects/4c29aaa1cc824b2c86db0b6115e34549` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:52.068344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c29aaa1cc824b2c86db0b6115e34549)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:52.069795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2515a-4664-4c7f-9455-c5f8ce03c5c5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:52.071420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 566/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:48:51 2022] GET /identity/v3/projects/4c29aaa1cc824b2c86db0b6115e34549 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:52.078082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624f41-707f-4bca-8d24-898be255428b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:52.191469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624f41-707f-4bca-8d24-898be255428b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:52.223927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:52.230767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:52.231375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:52.231652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:52.231921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:52.232680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] RBAC: Adding query filter params (role.id=4594ed7f7a2a46e0ac3c6b0740bda66e, scope.project.id=4c29aaa1cc824b2c86db0b6115e34549, user.id=5a4256d12d4d44928bda1d566452f85b) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:48:52.232989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:52.234832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68383391-9a6b-4ad9-b680-e9013ba0959f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:52.240686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 564/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:48:52 2022] GET /identity/v3/role_assignments?user.id=5a4256d12d4d44928bda1d566452f85b&scope.project.id=4c29aaa1cc824b2c86db0b6115e34549&role.id=4594ed7f7a2a46e0ac3c6b0740bda66e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:54.440650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df9fc-4ee0-4284-bb27-bd390301dbcf None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:54.441162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df9fc-4ee0-4284-bb27-bd390301dbcf None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:54.441162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df9fc-4ee0-4284-bb27-bd390301dbcf None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:54.442466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 567/1131] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:54.447783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:54.448166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:54.448332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:54.466522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:54.467703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:54.532967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 565/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:54.801293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df9fc-4ee0-4284-bb27-bd390301dbcf None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:54.902665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df9fc-4ee0-4284-bb27-bd390301dbcf None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:54.937289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:54.937897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:54.938170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:54.938435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:54.939523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:54.940958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2075e-4e96-4bf8-a5ff-ecb8049e3720 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:54.942475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 568/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:54.948318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:55.043771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6b044-0455-4827-ac1e-cf364caad567 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:55.067343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:55.077945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:55.078539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:55.078813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:55.079086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:55.079721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:55.081168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df018e42-ba4f-4e47-9b83-a2acae2c4119 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:55.106642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 566/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:48:54 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:48:57.321381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0e1ff-a490-491b-83be-4e77cc9e0bb9 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:57.321886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0e1ff-a490-491b-83be-4e77cc9e0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:57.321886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0e1ff-a490-491b-83be-4e77cc9e0bb9 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:57.323178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 569/1135] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:48:57.329016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:57.329436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:57.329551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:57.348309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:48:57.349529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:48:57.415200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 567/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:48:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:48:57.693336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0e1ff-a490-491b-83be-4e77cc9e0bb9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:57.705412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:57.790947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0e1ff-a490-491b-83be-4e77cc9e0bb9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:57.824109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:57.824753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:57.825034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:57.825303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:57.826402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:57.827993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406debc0-d6be-4d50-9322-ade9372a1193 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:57.829551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 570/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:48:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:48:57.835463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:48:57.932745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d62c2-8151-448f-bc06-c37c4bdfea6b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:48:57.939941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:48:57.966793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:48:57.967335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:48:57.968170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:48:57.968502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:48:57.969188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:48:57.970611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbdbb-e38f-40f2-ac95-638bc1f70bc2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:48:57.991378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 568/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:48:57 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:49:00.191267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acaf3-ca7a-4f16-a1cf-619cd67bc74e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:00.191813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acaf3-ca7a-4f16-a1cf-619cd67bc74e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:00.191907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acaf3-ca7a-4f16-a1cf-619cd67bc74e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:00.193205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 571/1139] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:00.198442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:00.198850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:00.198979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:00.217133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:00.218513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:00.282426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 569/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:00.552916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27acaf3-ca7a-4f16-a1cf-619cd67bc74e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:00.629866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:00.652636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27acaf3-ca7a-4f16-a1cf-619cd67bc74e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:00.685313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:00.685930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:00.686208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:00.687105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:00.697872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:00.702647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:00.703761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:00.704742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 572/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:00.709856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:00.797259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:00.806883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd5ab-67c1-424c-976e-c14aa38a2c7d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:00.839194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:00.839783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:00.840055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:00.840319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:00.841002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:00.841301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:00.843323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:00.851029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 570/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:00.856962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:00.955059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbd252-e743-4ca5-8448-102e820b649d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:00.988785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:00.989401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:00.989680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:00.989953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] PATH_INFO: `/v3/users/900376ecf06f46ffbf5c4711ef49cf8b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:00.996895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:01.003025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] RBAC: Authorizing `identity:get_user(user_id=900376ecf06f46ffbf5c4711ef49cf8b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:01.004455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:01.006067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 573/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:00 2022] GET /identity/v3/users/900376ecf06f46ffbf5c4711ef49cf8b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:01.011871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:01.111003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc8562-33fb-4009-a9dd-29068ca8b8e7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:01.142845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:01.143432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:01.143705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:01.143973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:01.167203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:01.210211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:01.211644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:01.306444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 571/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:49:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:49:01.312488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:01.408130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c40c-03ed-46e5-ba80-0414b8fc79d3 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:01.440329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:01.440976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:01.441257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:01.441531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] PATH_INFO: `/v3/projects/46e41cc11f084e259a706bd09434a85b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:01.442632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] RBAC: Authorizing `identity:get_project(project_id=46e41cc11f084e259a706bd09434a85b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:01.444057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da555b3-a75e-4ff0-b729-88af4ebde89d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:01.445675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 574/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:01 2022] GET /identity/v3/projects/46e41cc11f084e259a706bd09434a85b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:49:01.451724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:01.505615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:01.549868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726a9e-17be-4791-9495-41e89224dd1a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:01.583280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:01.583875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:01.584159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:01.584434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:01.585179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=46e41cc11f084e259a706bd09434a85b, user.id=900376ecf06f46ffbf5c4711ef49cf8b) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:01.585490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:01.586909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b80a-0893-4b21-b9d4-1760ccda7c06 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:01.592063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 572/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:49:01 2022] GET /identity/v3/role_assignments?user.id=900376ecf06f46ffbf5c4711ef49cf8b&scope.project.id=46e41cc11f084e259a706bd09434a85b&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:03.701020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca821-7905-42e4-af30-8a9c02ef8d34 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:03.701550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca821-7905-42e4-af30-8a9c02ef8d34 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:03.701550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eca821-7905-42e4-af30-8a9c02ef8d34 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:03.703613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 575/1147] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:03.708800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:03.709207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:03.709349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:03.727716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:03.728922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:03.792894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 573/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:04.081850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca821-7905-42e4-af30-8a9c02ef8d34 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:04.142115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:04.179732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eca821-7905-42e4-af30-8a9c02ef8d34 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:04.212871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:04.213508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:04.213785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:04.214053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:04.225422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:04.230121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:04.231224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:04.232430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 576/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:04.237350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:04.284467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:04.332899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba95a82-5b93-47f3-96ef-c9210b687968 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:04.365846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:04.366445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:04.366722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:04.366992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:04.367645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:04.367946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:04.369341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:04.377064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 574/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:04.382796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:04.479465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec6d9-2303-463e-a729-c489adda6504 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:04.501746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:04.512345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:04.512993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:04.513274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:04.513547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] PATH_INFO: `/v3/users/900376ecf06f46ffbf5c4711ef49cf8b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:04.515339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] RBAC: Authorizing `identity:get_user(user_id=900376ecf06f46ffbf5c4711ef49cf8b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:04.516807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:04.518353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 577/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:04 2022] GET /identity/v3/users/900376ecf06f46ffbf5c4711ef49cf8b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:04.524121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:04.621116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fa668-3b4f-4a2f-9565-b23971cda4e1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:04.631536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:04.654880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:04.655571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:04.655852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:04.656123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] PATH_INFO: `/v3/projects/46e41cc11f084e259a706bd09434a85b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:04.657375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] RBAC: Authorizing `identity:get_project(project_id=46e41cc11f084e259a706bd09434a85b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:04.658787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27c70-0e69-418e-baa0-7ec5b22a64ec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:04.660385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 575/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:04 2022] GET /identity/v3/projects/46e41cc11f084e259a706bd09434a85b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:04.666124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:04.762391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0693a53-d11a-4b1d-a592-7fd82e1cda1b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:04.795139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:04.795821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:04.796098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:04.796372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] PATH_INFO: `/v3/projects/46e41cc11f084e259a706bd09434a85b/users/900376ecf06f46ffbf5c4711ef49cf8b/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:04.798273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e41cc11f084e259a706bd09434a85b, user_id=900376ecf06f46ffbf5c4711ef49cf8b, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:04.799684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae870e-93f3-460e-8234-51c8bbad9f29 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:04.813046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 578/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:49:04 2022] PUT /identity/v3/projects/46e41cc11f084e259a706bd09434a85b/users/900376ecf06f46ffbf5c4711ef49cf8b/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:49:06.937246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487b69-ab62-4a71-83df-6805d6a702b9 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:06.937875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487b69-ab62-4a71-83df-6805d6a702b9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:06.937875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487b69-ab62-4a71-83df-6805d6a702b9 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:06.939143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 576/1154] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:06.944326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:06.944774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:06.944947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:06.963131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:06.964301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:07.009154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:07.029915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 579/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:07.299933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487b69-ab62-4a71-83df-6805d6a702b9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:07.400012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487b69-ab62-4a71-83df-6805d6a702b9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:07.432896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:07.433508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:07.433782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:07.434046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:07.444478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:07.449154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:07.450321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:49:07.451232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 577/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:07.456280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:07.555200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d493d1e-c008-441f-98a6-1aa0ff042b72 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:07.587300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:07.587886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:07.588159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:07.588503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:07.589181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:07.589477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:07.590827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:07.599053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 580/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:07.605019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:07.643956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:07.704480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecc714-ce27-467c-b67d-34f5f6a7f094 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:07.738476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:07.739088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:07.739365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:07.739634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] PATH_INFO: `/v3/users/900376ecf06f46ffbf5c4711ef49cf8b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:07.740793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] RBAC: Authorizing `identity:get_user(user_id=900376ecf06f46ffbf5c4711ef49cf8b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:07.742212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:07.743757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 578/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:07 2022] GET /identity/v3/users/900376ecf06f46ffbf5c4711ef49cf8b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:07.749781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:07.794951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:07.851222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad12cf-2183-456b-8e0b-f3fa4cd52568 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:07.883128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:07.883715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:07.883988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:07.884253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:07.948221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:07.949677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:07.991152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:08.043986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 581/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:49:08.049939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:08.145223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166e39-7efd-45fb-a435-0142633f05a2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:08.152165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:08.178643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:08.179255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:08.179530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:08.179798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] PATH_INFO: `/v3/projects/46e41cc11f084e259a706bd09434a85b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:08.180919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] RBAC: Authorizing `identity:get_project(project_id=46e41cc11f084e259a706bd09434a85b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:08.182347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112cc23-825b-4c63-b4cf-98a3b052cc2f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:08.183937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 579/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:08 2022] GET /identity/v3/projects/46e41cc11f084e259a706bd09434a85b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:08.190101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:08.285473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c65a-107c-45c0-836f-f26335ede78e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:08.317528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:08.318101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:08.318379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:08.318642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:08.319348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=46e41cc11f084e259a706bd09434a85b, user.id=900376ecf06f46ffbf5c4711ef49cf8b) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:08.319648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:08.321080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3e83-e0a5-4ded-b8e7-7644e3832e72 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:08.326502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 582/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:49:08 2022] GET /identity/v3/role_assignments?user.id=900376ecf06f46ffbf5c4711ef49cf8b&scope.project.id=46e41cc11f084e259a706bd09434a85b&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:49:10.471068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c23b38-a7f9-4e6a-bc61-d5aa9c44375c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:10.471595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c23b38-a7f9-4e6a-bc61-d5aa9c44375c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:10.471595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c23b38-a7f9-4e6a-bc61-d5aa9c44375c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:10.472956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 580/1162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:10.478007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:10.478440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:10.478563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:10.496939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:10.498118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:10.500800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:10.565130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 583/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:10.835472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c23b38-a7f9-4e6a-bc61-d5aa9c44375c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:10.941767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c23b38-a7f9-4e6a-bc61-d5aa9c44375c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:10.975156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:10.975752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:10.976027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:10.976294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:11.017893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:11.043777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:11.045289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:11.141564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 581/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:49:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:49:11.147424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:11.247972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d8a97-606a-4863-b7d9-aaa43bc99dc5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:11.282446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:11.283072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:11.283353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:11.283625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:11.290221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:11.291652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:11.293342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-37712159-a212-4ee0-811d-122ffdfbaf5d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:11.304532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:11.305798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:11.306902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 584/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:49:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:11.312482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:11.384650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:11.409866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f9ba-d1d5-416a-860f-6435fddf6275 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:11.443042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:11.443635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:11.443912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:11.444182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:11.444849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:11.445168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:11.446503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17aab9-2510-4072-b5ec-c3bcfd14b153 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:11.453433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 582/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 06:49:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:13.654883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d515-39f8-4f27-92f6-efed5eea680e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:13.655438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d515-39f8-4f27-92f6-efed5eea680e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:13.655438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d515-39f8-4f27-92f6-efed5eea680e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:13.656763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 585/1167] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:13.661999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489ee4-4300-4f0c-894a-551a6197563e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:13.662395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489ee4-4300-4f0c-894a-551a6197563e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:13.662539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489ee4-4300-4f0c-894a-551a6197563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:13.680325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c9489ee4-4300-4f0c-894a-551a6197563e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:13.681519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c9489ee4-4300-4f0c-894a-551a6197563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:13.747205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 583/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:14.014920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d515-39f8-4f27-92f6-efed5eea680e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:14.113785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d515-39f8-4f27-92f6-efed5eea680e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:14.145910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:14.146481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:14.146757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:14.147027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:14.147678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:14.149063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e84b5-131c-4329-a6f4-f8ef12a89bd6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:14.163941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 586/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Sep 13 06:49:14 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:49:16.321683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613565-f9a8-49f0-a431-6cc58b8ce29c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:16.322179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613565-f9a8-49f0-a431-6cc58b8ce29c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:16.322179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f613565-f9a8-49f0-a431-6cc58b8ce29c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:16.323502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 584/1170] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:16.329468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:16.329855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:16.330021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:16.349881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:16.351059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:16.401299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:16.415078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 587/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:16.682360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f613565-f9a8-49f0-a431-6cc58b8ce29c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:16.749268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:16.782685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f613565-f9a8-49f0-a431-6cc58b8ce29c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:16.815859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:16.816471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:16.816794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:16.817262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] PATH_INFO: `/v3/domains/7d79cd77432a442f8785d35d824c355b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:16.827329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d79cd77432a442f8785d35d824c355b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:16.828805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044e803-c23b-4f8b-b622-ae3885cd5b27 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:16.830367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 585/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 13 06:49:16 2022] GET /identity/v3/domains/7d79cd77432a442f8785d35d824c355b => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:16.836129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:16.931114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a273f6e-3c6f-4339-b98b-694623bede4a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:16.963612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:16.964144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:16.964417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:16.964710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:16.965345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:16.966755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da653d-ca40-4c6c-a135-fb6412bb42bd None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:16.992368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 588/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:49:16 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:49:19.149338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7974-9373-48b6-9cf4-408abadec33b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:19.149887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7974-9373-48b6-9cf4-408abadec33b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:19.149887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da7974-9373-48b6-9cf4-408abadec33b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:19.151184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 586/1174] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:19.156868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:19.157252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:19.157423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:19.175825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:19.177046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:19.210926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:19.249804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 589/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:19.526789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da7974-9373-48b6-9cf4-408abadec33b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:19.630444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da7974-9373-48b6-9cf4-408abadec33b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:19.656717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:19.664734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:19.665357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:19.665634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:19.665905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] PATH_INFO: `/v3/domains/7d79cd77432a442f8785d35d824c355b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:19.667004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d79cd77432a442f8785d35d824c355b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:19.668431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c6ba-f18a-4669-9b98-eaab7f0d7d8e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:19.670006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 587/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 13 06:49:19 2022] GET /identity/v3/domains/7d79cd77432a442f8785d35d824c355b => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:19.675787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:19.772838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2835b2-4998-4cb7-930a-639e64ea2c68 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:19.805636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:19.806163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:19.806437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:19.806703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:19.807338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:19.808773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ee9c3-abfe-4393-b90b-bbab04698f3d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:19.829937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 590/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:49:19 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:49:22.017095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814c8-6a73-434b-8523-9b3e4de6c498 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.017622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814c8-6a73-434b-8523-9b3e4de6c498 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.017622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9814c8-6a73-434b-8523-9b3e4de6c498 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:22.018951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 588/1178] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:22.024337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.024721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.024923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:22.042876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:22.044061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:22.064550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:22.111250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 591/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:22.386310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9814c8-6a73-434b-8523-9b3e4de6c498 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:22.484479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9814c8-6a73-434b-8523-9b3e4de6c498 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:22.517990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:22.518598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.518873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.519138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:22.530487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:22.535328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:22.536417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:49:22.537723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 589/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:22.542647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:22.638778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c82a7-b1dd-4a80-b838-6dc3b7afa3c6 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:22.671618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:22.672218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.672493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.672790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:22.673451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:22.673751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:22.675109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:22.683400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 592/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:22.689933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:22.746618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:22.789741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb7f16-23d3-4987-9a16-6c98629c1379 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:22.823041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:22.823663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.823940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.824213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] PATH_INFO: `/v3/users/234a98a85a194b27babbaf6846658ea7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:22.837451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] RBAC: Authorizing `identity:get_user(user_id=234a98a85a194b27babbaf6846658ea7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:22.838880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:22.840460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 590/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:22 2022] GET /identity/v3/users/234a98a85a194b27babbaf6846658ea7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:22.846522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:22.866561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:22.946574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6c55c-8885-4d40-ae0a-183e7a5fcc4b None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:22.978635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:22.979233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:22.979513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:22.979783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:23.046520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:23.047954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:23.065827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:23.144174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:49:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:49:23.150079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:23.250857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696049d-8b13-43b2-874b-7017e52cea46 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:23.264379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:23.283732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:23.284344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:23.284640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:23.284906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] PATH_INFO: `/v3/projects/916577fdcaf24563b87a4642a09d611c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:23.285990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] RBAC: Authorizing `identity:get_project(project_id=916577fdcaf24563b87a4642a09d611c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:23.287399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83657949-2f1c-4b7e-b1b4-1aa5d5bdcf6c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:23.289026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 591/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:23 2022] GET /identity/v3/projects/916577fdcaf24563b87a4642a09d611c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:23.296028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:23.391882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2f56-a0aa-4e1c-bb10-0db0d96c84c7 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:23.408658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:23.425540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:23.426127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:23.426403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:23.426671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:23.427641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=916577fdcaf24563b87a4642a09d611c, user.id=234a98a85a194b27babbaf6846658ea7) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:23.427946 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:23.429382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2137e-7d61-413c-88e9-1d7cfb9cb1db None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:23.434502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 594/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:49:23 2022] GET /identity/v3/role_assignments?user.id=234a98a85a194b27babbaf6846658ea7&scope.project.id=916577fdcaf24563b87a4642a09d611c&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:25.536291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f52f-6daf-453b-890c-228f01213a9c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:25.536827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f52f-6daf-453b-890c-228f01213a9c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:25.536923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629f52f-6daf-453b-890c-228f01213a9c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:25.538201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 592/1186] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:25.543194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:25.543557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:25.543730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:25.563098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:25.564262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:25.632395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 595/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:25.897629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629f52f-6daf-453b-890c-228f01213a9c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:25.995178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629f52f-6daf-453b-890c-228f01213a9c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:26.028949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:26.029878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:26.029995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:26.030188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:26.040014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:26.044725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:26.046853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:49:26.047900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 593/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:26.052717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:26.149564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3d1aa-21e3-411a-9a83-f15900ffe01f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:26.162436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:26.183710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:26.184306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:26.184604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:26.184881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:26.185605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:26.186908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:26.188283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:26.196035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 596/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:26.201860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:26.245262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:26.303037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f3de-e4a2-436d-af00-537fc6d46047 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:26.336543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:26.337188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:26.337467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:26.337738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] PATH_INFO: `/v3/users/234a98a85a194b27babbaf6846658ea7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:26.338861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] RBAC: Authorizing `identity:get_user(user_id=234a98a85a194b27babbaf6846658ea7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:26.340284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:26.342390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 594/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:26 2022] GET /identity/v3/users/234a98a85a194b27babbaf6846658ea7 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:26.348291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:26.448191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610f9ad-2331-4fea-aa7c-1a29ef1756e4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:26.480991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:26.481601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:26.481874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:26.482140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] PATH_INFO: `/v3/projects/916577fdcaf24563b87a4642a09d611c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:26.483806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=916577fdcaf24563b87a4642a09d611c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:26.485253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14de7-db6c-450a-8176-8a52c2086ed4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:26.486872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 597/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:26 2022] GET /identity/v3/projects/916577fdcaf24563b87a4642a09d611c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:26.492881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:26.591303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5b376-ac0b-4879-b662-1bec32f757a6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:26.603328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:26.627510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:26.628164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:26.628441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:26.628745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] PATH_INFO: `/v3/projects/916577fdcaf24563b87a4642a09d611c/users/234a98a85a194b27babbaf6846658ea7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:26.630624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=916577fdcaf24563b87a4642a09d611c, user_id=234a98a85a194b27babbaf6846658ea7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:26.632047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afca52-6c0a-420d-acf9-01bd66da2c14 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:26.645841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 595/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:49:26 2022] PUT /identity/v3/projects/916577fdcaf24563b87a4642a09d611c/users/234a98a85a194b27babbaf6846658ea7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:49:28.830771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c17c2-d0c0-42be-b988-f10a03ecb1a9 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:28.831331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c17c2-d0c0-42be-b988-f10a03ecb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:28.831331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c17c2-d0c0-42be-b988-f10a03ecb1a9 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:28.832647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 598/1193] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:49:28.837895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:28.838257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:28.838433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:28.856232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:49:28.857466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:49:28.921366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 596/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:49:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:49:29.195517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c17c2-d0c0-42be-b988-f10a03ecb1a9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:29.238770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:29.294388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c17c2-d0c0-42be-b988-f10a03ecb1a9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:29.327664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:29.328282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:29.328562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:29.328864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:29.339158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:49:29.344424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:49:29.345584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:49:29.346632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 599/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:49:29.351478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:29.451735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:29.454777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0bcc-b2ef-4db1-93da-c4470af38d47 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:29.489949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:29.490580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:29.490853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:29.491118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:29.491775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:29.492071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:29.493460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:29.502129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 597/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:29.507907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:29.603566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885e931-0bbd-4d56-a218-1596caee1643 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:29.605060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:29.637258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:29.637869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:29.638149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:29.638412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] PATH_INFO: `/v3/users/234a98a85a194b27babbaf6846658ea7` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:29.639815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] RBAC: Authorizing `identity:get_user(user_id=234a98a85a194b27babbaf6846658ea7)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:29.641333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:29.642859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 600/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 06:49:29 2022] GET /identity/v3/users/234a98a85a194b27babbaf6846658ea7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:29.648533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:29.749194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb2b4-67a2-4f53-bd72-e4021f4ae102 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:29.781755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:29.782335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:29.782613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:29.782880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:29.811132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:29.849264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:29.850693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:29.946757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 598/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:49:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:49:29.953300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:30.049220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b2559-4c5d-4f55-b4f7-f5dbf1fefcf1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:30.081881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:30.082495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:30.082770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:30.083037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] PATH_INFO: `/v3/projects/916577fdcaf24563b87a4642a09d611c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:30.084118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] RBAC: Authorizing `identity:get_project(project_id=916577fdcaf24563b87a4642a09d611c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:30.085555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7a1b4-0ce3-48fb-a1ed-7ffd10ad136d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:30.087137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 601/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 06:49:29 2022] GET /identity/v3/projects/916577fdcaf24563b87a4642a09d611c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:30.094007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:49:30.153716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:30.192493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936dcf-357c-4fd2-96d8-53b50bf4ee1a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:49:30.226428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:49:30.227030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:49:30.227305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:49:30.227574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:49:30.228286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=916577fdcaf24563b87a4642a09d611c, user.id=234a98a85a194b27babbaf6846658ea7) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:49:30.228618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:49:30.230046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b465514-4fe9-4143-abcd-9fa2ef56e9c5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:49:30.236070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 599/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:49:30 2022] GET /identity/v3/role_assignments?user.id=234a98a85a194b27babbaf6846658ea7&scope.project.id=916577fdcaf24563b87a4642a09d611c&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:49:40.077860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=81 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:49:40.234006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=37 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:26.670330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e78a5-0a63-4d06-9397-26a21fbcad74 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:26.670330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e78a5-0a63-4d06-9397-26a21fbcad74 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:26.670330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e78a5-0a63-4d06-9397-26a21fbcad74 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:26.672749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 602/1201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:26.679969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:26.680539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:26.680539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:26.703627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:26.705191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:26.810341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 600/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:27.130952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e78a5-0a63-4d06-9397-26a21fbcad74 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:27.261966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e78a5-0a63-4d06-9397-26a21fbcad74 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:27.308615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:27.309305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:27.309623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:27.309912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:27.321906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:27.323511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:27.344104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:27.345477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:27.346478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:27.346478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:27.346478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:27.346478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 603/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:27.351718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:27.476790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeefbc4-4241-407d-9a48-22d09e0c2269 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:27.522925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:27.525381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:27.525996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:27.526308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:27.526572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:27.527261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:27.527920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:27.530160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034c43b-3e5d-42bf-9152-0a60fb0c1bdb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:27.542823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 601/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:27.549306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:27.612320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:27.678814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613f05-cdfe-4d7c-8882-8dfa491fda56 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:27.716217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:27.717721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:27.718004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:27.718433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:27.719313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:27.720817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb159-c624-4024-aea0-7fba04990a62 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:27.749299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 604/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 06:50:27 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:50:30.169187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3b0f-ee46-44fb-b504-44147c77e3b2 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:30.170272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3b0f-ee46-44fb-b504-44147c77e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:30.170272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3b0f-ee46-44fb-b504-44147c77e3b2 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:30.171804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 602/1206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:30.177917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:30.178447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:30.178447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:30.198680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:30.199912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:30.276172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 605/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:30.556333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3b0f-ee46-44fb-b504-44147c77e3b2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:30.674314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3b0f-ee46-44fb-b504-44147c77e3b2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:30.716030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:30.719240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:30.721425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:30.721425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:30.733591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:30.738838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:30.740171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:30.741077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 603/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:30.746540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:30.792812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:30.868481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd395d95-6aa3-4c62-92a0-bbc061451337 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:30.908746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:30.909428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:30.909710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:30.909984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:30.910710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:30.911032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:30.912413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:30.922643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 606/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:30.928748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:30.988325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:31.062010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e0801-c538-47bb-8499-627f8c217d36 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:31.109632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:31.110342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:31.110626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:31.110896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:31.122061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:31.124233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:31.141534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:31.142920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:31.144035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:31.144035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:31.144035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:31.147668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 604/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:31.148687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:31.269157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:31.273095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b7a7-e3a4-40f0-9b67-99095d25260c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:31.315757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:31.316938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:31.317080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:31.317273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:31.317920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:31.318241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:31.319919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:31.334706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 607/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:31.340927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:31.477924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6604c-c77e-4694-8ab1-c62bce4e7555 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:31.479606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:31.530939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:31.531587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:31.531860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:31.532127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:31.540174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:31.541639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:31.554463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:31.555471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:31.557053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 605/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:50:31.562231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:31.668472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b619fb9-4417-4453-93cc-ded80aa4d456 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:31.705698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:31.706476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:31.706720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:31.707060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:31.707845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:31.708181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:31.709714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:31.736813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 608/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:31.737048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:31.863275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cf78a-b220-4c26-b4ef-8a0ff5090807 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:31.906583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:31.907193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:31.907465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:31.907727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:31.939314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:31.981327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:31.983480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:32.105010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:50:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:50:32.111751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:32.133944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:32.226132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb2a4-5524-47e5-bc33-440334a537a0 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:32.269600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:32.270283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:32.270488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:32.270756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:32.282184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:32.283558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:32.299974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:32.301118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:32.302026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:32.302026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:32.302026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:32.306260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 609/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:32.307315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:32.383844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:32.430801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b8571-5f75-4036-b2b4-5f0864fcd557 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:32.476510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:32.477370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:32.477747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:32.478165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:32.478938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:32.479333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:32.481769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:32.498871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 607/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:50:32.500050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:32.604384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:32.649125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d41be2-440e-48cf-9ae5-929509fb24e5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:32.697747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:32.698527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:32.698927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:32.699106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:32.708664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:32.712405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:32.725125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:32.726289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:32.728501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 610/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:50:32.733307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:32.867542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9466ce-2899-4222-a422-402f4fdf33e1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:32.897549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:32.914587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:32.915212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:32.915487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:32.915756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:32.916449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:32.916774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:32.918646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935df0-101c-43ae-aaee-10eb9b0aa6ba None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:32.933295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 608/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:32.940127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:33.063105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60961f8-e5b4-45e1-aab8-ca58d0da81d6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:33.098448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:33.105151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:33.105750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:33.106022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:33.106285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:33.107016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=1db27bb68c344df38e0f3ad7e0df0b46) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:33.107940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:33.109383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde67d1-4cca-4fec-a752-a62691c676b4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:33.114713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 611/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:50:32 2022] GET /identity/v3/role_assignments?user.id=1db27bb68c344df38e0f3ad7e0df0b46&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:35.517777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afba1-034b-4f90-a73d-346b0d4f9dce None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:35.518442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afba1-034b-4f90-a73d-346b0d4f9dce None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:35.518442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afba1-034b-4f90-a73d-346b0d4f9dce None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:35.519806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 609/1220] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:35.525949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685967-d487-443b-86db-5265d82e0b78 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:35.526407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685967-d487-443b-86db-5265d82e0b78 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:35.526608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685967-d487-443b-86db-5265d82e0b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:35.547502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-05685967-d487-443b-86db-5265d82e0b78 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:35.548842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-05685967-d487-443b-86db-5265d82e0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:35.624365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 612/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:35.905989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8afba1-034b-4f90-a73d-346b0d4f9dce None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.026616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8afba1-034b-4f90-a73d-346b0d4f9dce None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.065308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.065961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.066255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.066526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.079778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:36.084952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:36.086131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:36.087183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 610/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:36.095176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685967-d487-443b-86db-5265d82e0b78 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.210887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685967-d487-443b-86db-5265d82e0b78 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.239917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:36.252096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.252724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.252999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.253265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.253917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:36.254214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:36.255581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:36.264425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 613/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:36.270545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.322475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:36.390237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b68cb6-a23b-468a-8414-bdbd6c3fb66c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.430924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.431552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.431827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.432095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.444684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:36.447058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:36.464823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:36.465969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:36.467495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:36.467495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:36.467495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:36.468747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 611/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:36.472506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.582774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d257b6-68a1-4f6a-9bd7-e4b5af4bae29 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.622346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.623627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.623901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.624259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.625082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:36.625381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:36.627248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:36.643001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 614/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:50:36.648933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.755266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:36.764852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159914fd-0def-4915-8d1a-92cf840c53fe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.803082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.803718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.803994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.804262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.813301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:36.814754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:36.828623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:36.829832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:36.830781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 612/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:36.836287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:36.888169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:36.948216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8541b-2c61-4e61-9513-fa52f6283e27 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:36.987001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:36.987606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:36.987878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:36.988200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:36.989046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:36.989362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:36.991172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.010838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 615/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:37.017532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:37.125692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44908be2-1547-4eba-95c8-7e0b221bc4cf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:37.159324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:37.159954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:37.160229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:37.160498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:37.172875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:37.174431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:37.189877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:37.191060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:37.192059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:37.192059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:37.192059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:37.192059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 613/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:37.197044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:37.304791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dd1cc-6d63-41d0-aa1f-7c0629e4abc5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:37.307012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:37.347155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:37.347831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:37.348251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:37.348622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:37.349555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:37.349943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:37.351551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.365087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 616/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:37.371337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:37.382006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:37.505777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9523f-17dc-4eca-ad8e-09d1f90ff579 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:37.543737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:37.544410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:37.544789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:37.545264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:37.552772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:37.554240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:37.565876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:37.566946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:37.568011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 614/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:37.573098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:37.693275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c40eb-84b1-4260-936a-36c368cb33f4 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:37.735133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:37.735758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:37.736031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:37.736298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:37.737024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:37.737322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:37.738874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600dc58-073b-482e-9d1a-203ec2fd0e3a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.756450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 617/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:50:37.763817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:37.844090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:37.880978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5dfbd-2c56-49e2-b6ed-0ccb82476494 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:37.918133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:37.918788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:37.919075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:37.919325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/1db27bb68c344df38e0f3ad7e0df0b46/roles/68b2b5d2bc5d4259b540746004842c00` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:37.937050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=1db27bb68c344df38e0f3ad7e0df0b46, role_id=68b2b5d2bc5d4259b540746004842c00)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:37.938595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60aaa00-46d1-45a6-88d1-ca41ccec17b8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:37.953280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 615/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:50:37 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/1db27bb68c344df38e0f3ad7e0df0b46/roles/68b2b5d2bc5d4259b540746004842c00 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:50:40.163146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26120811-1389-4a22-8b61-8455132b1eea None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:40.163726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26120811-1389-4a22-8b61-8455132b1eea None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:40.163726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26120811-1389-4a22-8b61-8455132b1eea None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:40.165108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 618/1233] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:40.171708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:40.172191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:40.172556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:40.192033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:40.193280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:40.268868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 616/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:40.556861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26120811-1389-4a22-8b61-8455132b1eea None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:40.583996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:40.670793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26120811-1389-4a22-8b61-8455132b1eea None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:40.712279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:40.713010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:40.713337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:40.713596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:40.726912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:40.732202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:40.733568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:40.734949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 619/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 06:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:40.740149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:40.794230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:40.855749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7db0-5369-41b8-8ba5-c90cf03b6d0f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:40.893568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:40.894304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:40.894666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:40.894972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:40.895733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:40.896119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:40.897696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:40.906399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 617/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 06:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:40.912534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:41.010656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:41.030154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf1b69-ac8b-4dde-9c13-c2f38719558c None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:41.068681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:41.069316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:41.069594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:41.069862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:41.081041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:41.082756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:41.097608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:41.098795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:41.099976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:41.099976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:41.099976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:41.100926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 620/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:41.104434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:41.215360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ca96-50b9-4adb-b609-c157bb5c868a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:41.225251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:41.254725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:41.255327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:41.255600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:41.255866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:41.256497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:41.256851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:41.258167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:41.271200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 618/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:41.277604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:41.380687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730c045-7729-49b5-91b3-f8eef1ee8cab None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:41.415391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:41.416026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:41.416312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:41.416566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:41.419750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:41.425369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:41.426801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:41.438897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:41.440104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:41.441544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 621/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:41.446686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:41.563694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52189d-7650-4413-93f6-0a9bbc7b88a6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:41.599981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:41.600565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:41.600870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:41.601133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:41.601916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:41.602181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:41.603588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:41.623814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 619/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:41.629564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:41.748431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7594b5e-2e20-4161-acae-71f0118b11a5 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:41.789278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:41.790005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:41.790229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:41.790508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:41.860467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:41.868153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:41.869665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:41.986711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 622/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:50:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:50:41.993638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:42.026396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:42.105567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a50a8-33b5-4e58-8e84-b2b6dd55a465 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:42.141908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:42.142491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:42.142752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:42.143025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:42.153055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:42.155092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:42.170187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:42.171397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:42.172451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:42.172451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:42.172451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:42.172451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 620/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:42.177043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:42.284522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:42.291018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539803fe-24fb-41d4-99ea-364d26502e5d None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:42.330619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:42.331230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:42.331549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:42.331864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:42.332648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:42.332952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:42.334632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:42.348090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 623/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:42.354026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:42.444158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:42.467416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca82-3307-4c78-bcee-7c32e999b373 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:42.502451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:42.503083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:42.503338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:42.503602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:42.510686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:42.512463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:42.527052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:42.528271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:42.530092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 621/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:42.536251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:42.658684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65380c7d-9a62-429b-a4ce-9f34f8439439 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:42.701123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:42.701671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:42.701969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:42.702216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:42.702905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:42.703256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:42.704835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147c9a8-dc67-4ddf-94aa-456ca84a2236 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:42.719072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 624/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:42.725974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:42.849070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83c6b-ac1f-41a8-953c-746532a50086 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:42.885499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:42.886209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:42.886484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:42.886775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:42.887590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] RBAC: Adding query filter params (role.id=68b2b5d2bc5d4259b540746004842c00, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=1db27bb68c344df38e0f3ad7e0df0b46) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:42.888649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:42.890185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15891-175a-4c7e-8a34-fee7d0f9beae None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:42.896665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 622/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:50:42 2022] GET /identity/v3/role_assignments?user.id=1db27bb68c344df38e0f3ad7e0df0b46&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=68b2b5d2bc5d4259b540746004842c00 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:45.383845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d277-b579-4c7b-8942-a2735febb746 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:45.384367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d277-b579-4c7b-8942-a2735febb746 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:45.384367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6d277-b579-4c7b-8942-a2735febb746 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:45.385695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 625/1247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:45.391075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:45.391537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:45.391638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:45.397801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:45.411705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:45.412901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:45.486724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 623/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:45.765719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6d277-b579-4c7b-8942-a2735febb746 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:45.788084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:45.888984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6d277-b579-4c7b-8942-a2735febb746 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:45.925182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:45.925810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:45.926088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:45.926358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:45.937697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:45.943606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:45.944770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:45.946084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 626/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:45.951990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.070035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a835-b6fa-4c06-8b99-6c3e5d391601 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:46.104452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:46.111304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:46.111942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:46.112221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:46.112502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:46.113189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:46.113494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:46.114883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:46.123368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 624/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:46.129031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.214146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:46.240870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5c136-082f-4889-95c3-260389725a1e None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:46.279876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:46.280518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:46.280830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:46.281111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:46.292512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:46.294011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:46.311109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:46.312322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:46.313675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:46.313675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:46.313675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:46.313675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 627/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:46.318422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.426282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4439d7-6ecf-4330-bdf9-c9c6ac178a59 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:46.464904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:46.465841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:46.466874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:46.467271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:46.467994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:46.468268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:46.469851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:46.484829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 625/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:50:46.491254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.593737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca372c-fe7a-436a-aa3c-111dff8afe4a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:46.619564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:46.628313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:46.628970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:46.629241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:46.629509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:46.637979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:46.639622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:46.651010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:46.652182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:46.654136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 628/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:46.658939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.723696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:46.775257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47499-ed8a-4b4c-832d-05fd77341399 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:46.814001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:46.814707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:46.814966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:46.815262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:46.815995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:46.816331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:46.817798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:46.839386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 626/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:46.847329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:46.968302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4b36f-5693-453a-bdd0-d619912940aa None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.003861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.004471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.004777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.005048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.065429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:47.081297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.082801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.191436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 629/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:50:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:50:47.192861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:47.301668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af540-ccc2-44fb-aec4-b8c0b94de817 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.316546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:47.338801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.339430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.339706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.339977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.351168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.352656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:47.369026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:47.370095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:47.371047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:47.371047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:47.371047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:47.371047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 627/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:47.376964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:47.467869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:47.480741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0c10-6484-4acb-9efb-1c2959d7d2d9 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.515889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.516517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.516792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.517063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.517706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:47.518005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.519362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.531134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 630/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:47.536805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:47.634980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5029876-7177-43ee-b05d-49e10cfdff1a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.667265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.667878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.668153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.668420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.675415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.676874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:47.688052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:47.689150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:47.690095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 628/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:47.695022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:47.804561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b752cbb-0ac8-4782-8eac-e73a680ba34a None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.837506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.838097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.838373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.838643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.839321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:47.839622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.842196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541e84-e7b6-4218-8bad-92c293e81ea0 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.853875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 631/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:47.860116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:47.885140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:47.958596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025807-455e-4be8-96a7-99e17a147865 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:47.990434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:47.991016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:47.991289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:47.991556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:47.992257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=1db27bb68c344df38e0f3ad7e0df0b46) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:47.992557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:47.993985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63a33-4c6e-44e8-a74a-9ef656f8e84f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:47.999097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 629/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:50:47 2022] GET /identity/v3/role_assignments?user.id=1db27bb68c344df38e0f3ad7e0df0b46&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:50.129629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7e33-9def-4662-895e-d5ae063b8aab None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:50.130164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7e33-9def-4662-895e-d5ae063b8aab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:50.130164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df7e33-9def-4662-895e-d5ae063b8aab None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:50.131506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 632/1261] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:50.136697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:50.137087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:50.137250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:50.156090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:50.157299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:50.222417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 630/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:50.490302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df7e33-9def-4662-895e-d5ae063b8aab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:50.501620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:50.592472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df7e33-9def-4662-895e-d5ae063b8aab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:50.626347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:50.626961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:50.627236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:50.627505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:50.637740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:50.642544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:50.643672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:50.644612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 633/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:50:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:50.649648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:50.667866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:50.760332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a410-fc46-4eb9-bdd5-7e73ec1f1cef None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:50.802117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:50.802974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:50.803247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:50.803519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:50.804174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:50.804469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:50.805860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:50.814004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 631/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:50:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:50.819787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:50.892091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:50.925755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ca10-eff1-4e40-a2e3-33baa25ec860 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:50.959168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:50.959781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:50.960058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:50.960326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:50.972041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:50.973499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:50.987368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:50.988488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:50.989613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:50.989613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:50.989613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:50.989613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 634/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:50.995811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.078556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:51.098940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c2b7-60c6-4b64-98ed-67f314cbf91f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.132336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.132971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.133244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.133509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.134140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:51.134436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.135787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.148731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 632/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:51.154541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.251955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025f4b-2571-43dc-ba1f-199a0c50cca1 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.270337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:51.284721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.285266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.285539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.285804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.292866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.294826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:51.305810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:51.306993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:51.308164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 635/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:50:51.312822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.408120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaecfb-a25b-4542-b593-57fc89b004d3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.440769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.441353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.441625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.441890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.442595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:51.442893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.444292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.453113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:51.461398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 633/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:51.467544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.566460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57913d73-1df6-46a9-9aaf-7e383ecc81a6 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.603853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.604466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.604765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.605031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.615559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.617018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:51.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:51.632176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:51.633342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:51.633342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:51.633342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:51.633342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 636/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:51.637999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.748320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ea2d-aeb5-44b2-942e-0dfbe5a725a3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.783816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.784419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.784723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.784993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.785630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:51.785930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.787292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.799224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 634/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:51.805237 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.837632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:51.914053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3eeb-1d42-4d2c-b921-4bb6d240b217 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.949784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.950901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.951185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.951458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.959265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.960726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:51.973699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:51.974807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:51.975937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 637/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:51.981211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:52.045458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:52.088133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b7565-342e-455d-9e28-ebc3d824d5f6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:52.130770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:52.131359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:52.131632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:52.131894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:52.132603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:52.132906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:52.134350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec8bd-d5b2-402b-9605-d20b23839452 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:52.148069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 635/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:52.154798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:52.266267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:52.275051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece42f4-3129-4d15-a4dc-2b0c040771ee None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:52.316129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:52.316802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:52.317075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:52.317338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] PATH_INFO: `/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/1db27bb68c344df38e0f3ad7e0df0b46/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:52.319196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb4d5bf50a4dc2842f06871b92408d, user_id=1db27bb68c344df38e0f3ad7e0df0b46, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:52.320634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f2665-427f-4709-8014-daa2d5d8f82c None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:52.335083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 638/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 06:50:52 2022] PUT /identity/v3/projects/3ffb4d5bf50a4dc2842f06871b92408d/users/1db27bb68c344df38e0f3ad7e0df0b46/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:50:54.474158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5a710-f2a0-4bee-a5fe-8a425809f3d8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:54.474687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5a710-f2a0-4bee-a5fe-8a425809f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:54.474687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5a710-f2a0-4bee-a5fe-8a425809f3d8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:54.475959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 636/1274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:54.481023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:54.481991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:54.482113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:54.505743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:54.506928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:54.571775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 639/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:50:54.845852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5a710-f2a0-4bee-a5fe-8a425809f3d8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:54.946794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5a710-f2a0-4bee-a5fe-8a425809f3d8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:54.963762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:54.982578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:54.983199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:54.983477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:54.983748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:54.993585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:50:54.999253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:55.000370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:55.001658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 637/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 06:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:55.006318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.085521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.106053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80420-539b-45c6-85d0-57db9e3dd0a5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.139750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.140346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.140649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.140922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:55.141582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:55.141885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:55.143241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:55.151037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 640/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:55.156946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.258081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dc08c-630f-4b63-b2fe-a8d26bb1accc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.291168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.291780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.292057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.292323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:55.303149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:55.304602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:55.319767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:55.321008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:55.322086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:55.322086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:55.322086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:55.322086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 638/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:55.327052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.423127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82203-517e-45dd-bd38-e5fec1c78d51 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.457530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.458266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.458677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.459036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:55.459668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:55.459963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:55.461743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:55.473114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 641/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:55.478771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.510253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.580456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979151df-c25a-4f2a-abf0-d3ad5cbfe7bb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.614408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.615014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.615291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.615561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:55.624060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:55.625517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:50:55.636332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:55.637450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:55.638455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 639/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:55.643370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.647181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.746639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123134-2593-4e78-b2eb-6f804af5fc01 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.780548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.781163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.781439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.781708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:55.782425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:55.782726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:55.784141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:55.802292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 642/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:55.808425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:55.896682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:55.906801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb58a-de1a-45a1-b51b-65cc5d3fcb8b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:55.940288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:55.940909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:55.941186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:55.941454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.005894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.007261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.095872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:56.106160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 640/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 06:50:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:50:56.112235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:56.172547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:56.210848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd083-f520-4230-96d5-1db2d787a012 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:56.244903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:56.245518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:56.245793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:56.246061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.256111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.257529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:50:56.272420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:56.273539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:50:56.274495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:50:56.274495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:50:56.274495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:56.274495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 643/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:56.279863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:56.376185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2468b0-4e2c-4504-ba1f-fa06682d1f32 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:56.409882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:56.410470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:56.410746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:56.411013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.411640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:56.411936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.413316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.424278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 641/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 06:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:50:56.430007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:56.529094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389d30-3017-4867-aa48-03768f9bdbdc None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:56.541806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:56.563835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:56.564448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:56.564755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:56.565029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.571398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.572850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:50:56.584110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:56.585171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: ERROR keystone.server.flask.application Sep 13 06:50:56.586173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 644/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 06:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:56.591581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:56.640380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:56.690974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455d1ef-98a0-4b8f-9b12-046e947c3dfa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:56.724564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:56.725189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:56.725468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:56.725736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.726418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:56.726721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.728129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c92b67-0d20-4b46-8eb6-0a35f045bd56 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.740060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 642/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 06:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:56.746022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:56.845563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bda0-b55b-4fdd-847b-2d717b5442ad None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:56.877663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:56.878243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:56.878520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:56.878788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:56.879505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] RBAC: Adding query filter params (role.id=9178ca05cc9a4676818f53f8a2f1309f, scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d, user.id=1db27bb68c344df38e0f3ad7e0df0b46) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:56.879808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:56.881255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a2cf5-deb4-4e74-bf4e-02c21c83908a None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:56.886774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 645/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 06:50:56 2022] GET /identity/v3/role_assignments?user.id=1db27bb68c344df38e0f3ad7e0df0b46&scope.project.id=3ffb4d5bf50a4dc2842f06871b92408d&role.id=9178ca05cc9a4676818f53f8a2f1309f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:59.081955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668b4d-962f-4367-a29e-688bad92a609 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:59.082423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668b4d-962f-4367-a29e-688bad92a609 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:59.082515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef668b4d-962f-4367-a29e-688bad92a609 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:59.083818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 643/1288] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:50:59.088924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:59.089345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:59.089481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:59.108427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:50:59.109632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:59.139197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:59.177658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 646/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:50:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:50:59.451586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef668b4d-962f-4367-a29e-688bad92a609 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:59.549739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef668b4d-962f-4367-a29e-688bad92a609 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:59.560701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:59.584736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:59.585348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:59.585619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:59.585883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:59.586444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:59.587805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:50:59.596523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:50:59.597745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:50:59.598629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 644/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:50:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:50:59.603558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:59.698564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b2ad8-0e94-4a12-952a-d8db4106e839 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:59.736233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:59.736940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:59.737216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:59.737559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:59.738189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:59.738485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:59.739956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a01e8d-6041-4734-9f66-a4656c0d994b None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:59.745501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 647/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 06:50:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:50:59.752627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:59.855786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258f671-cc72-4268-a6fd-ffb9d388eee6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:59.889117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:59.889707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:59.889979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:59.890245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:59.890864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:50:59.891159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:59.892506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644a35b-a40e-41c5-afe4-f64b9fc6b474 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:59.899327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 645/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 06:50:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:51:02.022968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2f1d-e915-47a2-9e3b-66c893877864 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:02.023486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2f1d-e915-47a2-9e3b-66c893877864 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:02.023486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b2f1d-e915-47a2-9e3b-66c893877864 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:02.024853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 648/1293] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:51:02.030752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9848a-1720-4c7e-b548-4174af9ae6ad None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:02.031152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9848a-1720-4c7e-b548-4174af9ae6ad None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:02.031295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9848a-1720-4c7e-b548-4174af9ae6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:02.049209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c6e9848a-1720-4c7e-b548-4174af9ae6ad None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:51:02.050382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6e9848a-1720-4c7e-b548-4174af9ae6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:51:02.080257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:02.117732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 646/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:51:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:51:02.384146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2f1d-e915-47a2-9e3b-66c893877864 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:02.420450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:02.490599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b2f1d-e915-47a2-9e3b-66c893877864 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:02.522707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:02.523302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:02.523579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:02.523851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:02.524505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:02.525887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bca3f-9f7d-44a3-82e0-2da351069b73 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:02.540930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 649/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 06:51:02 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:51:04.698054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d445-88e0-4437-8067-3211d7faa07d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:04.698582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d445-88e0-4437-8067-3211d7faa07d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:04.698582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d445-88e0-4437-8067-3211d7faa07d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:04.700524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 647/1296] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:51:04.706208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:04.706662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:04.706942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:04.728289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:51:04.729690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:51:04.810597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 650/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:51:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:51:05.081522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376d445-88e0-4437-8067-3211d7faa07d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:05.181066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376d445-88e0-4437-8067-3211d7faa07d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:05.213745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:05.214363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:05.214642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:05.214915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:05.216089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:05.217477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:51:05.225974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:51:05.227130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:05.228278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 648/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:51:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:51:05.233321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:05.250872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:05.330670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc885d9-7207-4f92-841e-57ca726ca565 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:05.362707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:05.363302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:05.363581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:05.363851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:05.364471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:51:05.364800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:05.366157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:05.371071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 651/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 06:51:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:51:05.377871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:05.409712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:05.475724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6689-0a05-45fa-bc11-ec94abacec6f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:05.507410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:05.507994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:05.508268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:05.508532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:05.509251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] RBAC: Adding query filter params (interface=public, service_id=77d0725c6dca408582ab929285e7d12f, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:51:05.509554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:05.510903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531d1f5-1c1c-4154-bf30-6ade66597c88 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:05.516028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 649/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 06:51:05 2022] GET /identity/v3/endpoints?service_id=77d0725c6dca408582ab929285e7d12f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:51:05.521709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:05.600765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:05.618881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5886c-1dbc-43c5-9d13-30858b81cb97 None admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:05.651025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:05.651618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:05.651898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:05.652172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:05.652801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:05.654783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7e7b1-4ac0-46cc-84aa-9e2162b3555f None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:05.661368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 652/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 06:51:05 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:51:07.801318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecd3f-fc8b-4664-8a55-d0ce3e0135d0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:07.801852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecd3f-fc8b-4664-8a55-d0ce3e0135d0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:07.801852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecd3f-fc8b-4664-8a55-d0ce3e0135d0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:07.803429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 650/1302] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:51:07.808824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:07.809715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:07.810016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:07.828304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:51:07.829532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:51:07.893654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 653/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:51:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:51:08.160711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecd3f-fc8b-4664-8a55-d0ce3e0135d0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:08.253730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:08.260782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecd3f-fc8b-4664-8a55-d0ce3e0135d0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:08.294375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:08.294983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:08.295256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:08.295520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:08.296084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:08.297452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:51:08.306157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:51:08.307306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Sep 13 06:51:08.308354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 651/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 06:51:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:51:08.313784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:08.387925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:08.410134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c333e-d224-44f5-a85f-784bcc2da541 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:08.443896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:08.444427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:08.444733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:08.445006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] PATH_INFO: `/v3/services` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:08.445630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:51:08.445927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:08.447273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76d321-b7e7-4ed5-96e3-157cf386b316 None admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:08.452771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 654/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 06:51:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:51:08.458417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:51:08.557547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39c22-88fb-4014-9bdc-b2ba7781ea48 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:51:08.590218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:51:08.590830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:51:08.591101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:51:08.591366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:51:08.592024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:51:08.593406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28631e-e0ff-4e4d-bdee-99b020bc5d40 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:51:08.612279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 652/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:51:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:51:18.449482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=30 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:51:18.608145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:12.670952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ad30-6921-4465-bc96-bc7888b14ea3 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:12.671417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ad30-6921-4465-bc96-bc7888b14ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:12.671641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494ad30-6921-4465-bc96-bc7888b14ea3 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:12.676252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 655/1307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:12.678588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e40a3-f319-4177-aa3b-e039e09fa531 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:12.679009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e40a3-f319-4177-aa3b-e039e09fa531 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:12.679195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e40a3-f319-4177-aa3b-e039e09fa531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:12.840024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5a8e40a3-f319-4177-aa3b-e039e09fa531 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:12.842349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5a8e40a3-f319-4177-aa3b-e039e09fa531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:13.005311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 653/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:13.306881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:13.307229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:13.307437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:13.309661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 656/1309] 10.222.0.48 () {54 vars in 965 bytes} [Tue Sep 13 06:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:13.315349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2f81-965d-4f47-b19e-59e1d488e610 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:13.315986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2f81-965d-4f47-b19e-59e1d488e610 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:13.316500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc2f81-965d-4f47-b19e-59e1d488e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:13.407918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cdfc2f81-965d-4f47-b19e-59e1d488e610 None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:13.409561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cdfc2f81-965d-4f47-b19e-59e1d488e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:13.434446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:13.500129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 654/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Sep 13 06:52:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:13.509765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:13.512095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:13.632091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb1359-e2f7-45db-972d-eab0a0dac3ab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:13.715100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:13.716766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:13.717281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:13.717866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:13.719888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:13.782521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:13.845541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:13.846891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a41e8b-f637-4655-8254-108fa040561e service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:13.867431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 657/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:16.326060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:16.326639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:16.326639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:16.327966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 655/1312] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:16.333424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45293-a031-4050-a6fa-79360d4d62f3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:16.333889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45293-a031-4050-a6fa-79360d4d62f3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:16.333985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45293-a031-4050-a6fa-79360d4d62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:16.416702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8be45293-a031-4050-a6fa-79360d4d62f3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:16.418756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8be45293-a031-4050-a6fa-79360d4d62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:16.529192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 658/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:16.816128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:16.818153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:16.937413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629fc5b-958f-46df-8b95-7fb24eb0d1e5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:17.013667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:17.015927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:17.016507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:17.016827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:17.017346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:17.021724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:17.129662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:17.131025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a7cdb-1dd0-46ed-8202-9c6755f624b6 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:17.150975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 656/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:19.637231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:19.637810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:19.637810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:19.639210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 659/1315] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:19.644333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253523-4648-46bc-9daa-1964bd9e254e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:19.644759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253523-4648-46bc-9daa-1964bd9e254e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:19.644908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca253523-4648-46bc-9daa-1964bd9e254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:19.710112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ca253523-4648-46bc-9daa-1964bd9e254e None None] MFA Rules not processed for user `8cdf4c1b6e3c4d9186a45a8ecd343659`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:19.711517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca253523-4648-46bc-9daa-1964bd9e254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:19.765977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:19.810883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 657/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:20.099160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:20.100713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:20.111132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:20.202147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d16e0-e6e1-4666-97e0-ddef6be29286 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:20.273861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:20.274389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:20.274660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:20.274926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:20.277081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:20.343132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:20.389480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:20.390921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0367538-004b-4d08-9f10-a13e0438f466 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:20.409487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 660/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:23.097483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:23.097997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:23.098091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:23.099387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 658/1318] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:23.105258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351de6a-29af-4046-abeb-580b7c6f391a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:23.105724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351de6a-29af-4046-abeb-580b7c6f391a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:23.105995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351de6a-29af-4046-abeb-580b7c6f391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:23.170732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5351de6a-29af-4046-abeb-580b7c6f391a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:23.171922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5351de6a-29af-4046-abeb-580b7c6f391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:23.266711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 661/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:23.578566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:23.580097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:23.681299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fff7b-878d-4050-9064-a1d052a27374 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:23.756067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:23.756692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:23.756968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:23.757235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:23.758811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:23.766221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:23.865848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:23.867188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719c53-3277-47f6-8631-c99266f712a3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:23.885416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 659/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:52:26.698287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:26.698851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:26.698851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:26.700206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 662/1321] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:26.705871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbe1f1-1edc-49dc-9c86-a4fab82162ff None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:26.706399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbe1f1-1edc-49dc-9c86-a4fab82162ff None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:26.706399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbe1f1-1edc-49dc-9c86-a4fab82162ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:26.784095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f5cbe1f1-1edc-49dc-9c86-a4fab82162ff None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:26.785367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f5cbe1f1-1edc-49dc-9c86-a4fab82162ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:26.849637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:26.891671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 660/1322] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:27.172689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:27.174265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:27.195217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:27.278576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f278f5-c67f-45e4-9ed0-3692803d5cfa None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:27.352120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:27.352794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:27.353077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:27.353352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:27.355477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:27.427640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:27.466437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:27.467871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f34d7-9e7d-4400-ba12-4ebcf63e7d99 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:27.486175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 663/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:29.719758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:29.720291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:29.720291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:29.721679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 661/1324] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:29.726859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f381-85fc-4922-a910-dc784d240b08 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:29.727304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f381-85fc-4922-a910-dc784d240b08 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:29.727403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1f381-85fc-4922-a910-dc784d240b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:29.806368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-83b1f381-85fc-4922-a910-dc784d240b08 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:29.807613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-83b1f381-85fc-4922-a910-dc784d240b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:29.906747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 664/1325] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:52:30.190194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:30.191755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:30.296368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e495faa-5e1f-41ec-9ee9-eee609c89a07 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:30.369875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:30.371056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:30.371335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:30.371605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:30.373237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:30.390326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:30.487592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:30.489103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc5b77-271b-4423-93c0-e1dddcc2894a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:30.507565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 662/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:32.814836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0f5f-9b05-4b25-8a5b-0f1a4732b289 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:32.815345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0f5f-9b05-4b25-8a5b-0f1a4732b289 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:32.815440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0f5f-9b05-4b25-8a5b-0f1a4732b289 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:32.816739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 665/1327] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:32.822137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3aa0-d5c5-490e-83e7-76eef6b54cf9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:32.822552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3aa0-d5c5-490e-83e7-76eef6b54cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:32.822678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3aa0-d5c5-490e-83e7-76eef6b54cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:32.890558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6bbf3aa0-d5c5-490e-83e7-76eef6b54cf9 None None] MFA Rules not processed for user `8cdf4c1b6e3c4d9186a45a8ecd343659`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:32.891788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6bbf3aa0-d5c5-490e-83e7-76eef6b54cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:32.959108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:32.991950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 663/1328] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:33.299301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:33.299591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:33.299866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:33.301226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 666/1329] 10.222.0.48 () {54 vars in 965 bytes} [Tue Sep 13 06:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:52:33.308184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a5f1-4c31-4db4-980e-96e0a32e3f97 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:33.308745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a5f1-4c31-4db4-980e-96e0a32e3f97 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:33.310007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a5f1-4c31-4db4-980e-96e0a32e3f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:33.394305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5765a5f1-4c31-4db4-980e-96e0a32e3f97 None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:33.395522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5765a5f1-4c31-4db4-980e-96e0a32e3f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:33.473176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 664/1330] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Sep 13 06:52:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:33.482520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:33.484084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:33.516020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:33.588364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ab037-8ddd-4c4a-8b5a-96f8133340f3 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:33.661631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:33.662242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:33.662523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:33.662796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:33.664401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:33.743191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:33.776620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:33.778140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e361f04-5f2a-4b05-b4bc-6f8607a5cbab service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:33.797179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 667/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:36.553139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:36.553674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:36.554007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:36.555346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 665/1332] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:36.561496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca63e-4975-4035-b5af-7a00710aca17 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:36.561926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca63e-4975-4035-b5af-7a00710aca17 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:36.562072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca63e-4975-4035-b5af-7a00710aca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:36.627352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-731ca63e-4975-4035-b5af-7a00710aca17 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:36.628546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-731ca63e-4975-4035-b5af-7a00710aca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:36.727451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 668/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:52:37.010167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:37.012236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:37.081607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:37.115832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f8e92-7a71-4dac-af0c-da3f21c7792f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:37.187690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:37.188291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:37.188566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:37.188863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:37.190451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:37.297956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:37.299310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dda6e-753e-436c-84e5-bb90cbddb347 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:37.309961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:37.318337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 666/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:39.555176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:39.555727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:39.555727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:39.557582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 669/1335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:39.563507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2317f-0bae-4bf3-bbde-c3beefb06c70 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:39.563939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2317f-0bae-4bf3-bbde-c3beefb06c70 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:39.564061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2317f-0bae-4bf3-bbde-c3beefb06c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:39.629905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b3a2317f-0bae-4bf3-bbde-c3beefb06c70 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:39.631100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b3a2317f-0bae-4bf3-bbde-c3beefb06c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:39.726083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 667/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:40.011084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:40.012680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:40.051682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:40.113812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180dd2-5e9c-420e-8169-2c2b601ef029 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:40.184360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:40.184980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:40.185255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:40.185519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:40.187088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:40.268727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:40.294163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:40.295789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bb21d-b31a-4125-a014-7f6e863a3b28 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:40.314222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 670/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:42.828073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:42.828818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:42.828818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:42.829975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 668/1338] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:42.835118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3fca-cb45-4479-abaa-ed9ce4246bf7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:42.835544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3fca-cb45-4479-abaa-ed9ce4246bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:42.835663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3fca-cb45-4479-abaa-ed9ce4246bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:42.899859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1e8c3fca-cb45-4479-abaa-ed9ce4246bf7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:42.901704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1e8c3fca-cb45-4479-abaa-ed9ce4246bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:43.000977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 671/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:43.291132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:43.293047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:43.370382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:43.398701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0df575-75d6-4629-8422-0ad0131b93f7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:43.473148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:43.473747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:43.474027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:43.474295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:43.475875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:43.586736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:43.588803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd510bd2-ea15-4d52-9bd7-75c507988c70 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:43.618150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 669/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:47.891677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:47.892259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:47.892259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:47.893729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 672/1341] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:47.898869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e57-dc77-436a-9de5-38539b3821a2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:47.899280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e57-dc77-436a-9de5-38539b3821a2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:47.899390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee7e57-dc77-436a-9de5-38539b3821a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:47.905358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:47.967037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c6ee7e57-dc77-436a-9de5-38539b3821a2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:47.968148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6ee7e57-dc77-436a-9de5-38539b3821a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:48.069831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 670/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:48.352172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:48.354269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:48.405380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:48.462361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33155e-766e-43ee-962a-b6d23010302e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:48.538350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:48.538951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:48.539224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:48.539489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:48.541104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:48.637467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:48.655053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:48.656497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356280ad-4df1-4b7c-90d1-e35db6ce5f9d service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:48.675896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 673/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:51.485445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:51.485982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:51.485982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:51.487349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 671/1344] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:51.492442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b378-aeaa-4951-8af4-463db89e9c9b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:51.492870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b378-aeaa-4951-8af4-463db89e9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:51.493068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b378-aeaa-4951-8af4-463db89e9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:51.560336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2457b378-aeaa-4951-8af4-463db89e9c9b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:51.561580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2457b378-aeaa-4951-8af4-463db89e9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:51.658937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 674/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:51.941580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:51.943122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:52.040546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:52.059502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83001805-a76b-4a72-a031-f6896cbe3f3a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:52.133928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:52.134535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:52.135297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:52.135567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:52.137179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:52.249673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:52.251207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f253-5e0b-4bc7-bc0b-fdae09e5cdce service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:52.269580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 672/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:52:56.495827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:56.496350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:56.496350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:56.497959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 675/1347] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:52:56.503306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95b5d7-531b-4a7a-8df8-f19429caf947 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:56.503741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95b5d7-531b-4a7a-8df8-f19429caf947 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:56.503835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95b5d7-531b-4a7a-8df8-f19429caf947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:56.519717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:56.578428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5d95b5d7-531b-4a7a-8df8-f19429caf947 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:52:56.580064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5d95b5d7-531b-4a7a-8df8-f19429caf947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:56.692847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 673/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:52:56.981475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:52:56.983010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:57.041928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:57.087292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe05a-c898-4872-bbcb-0ac4ca9a31a7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:52:57.160686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:52:57.161281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:52:57.161552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:52:57.161814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:52:57.163674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:52:57.266373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:52:57.269642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:52:57.271583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ed28-e773-49a5-9301-79a89dc56a17 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:52:57.290131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 676/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:02.298738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68d73-a6d1-4da9-994e-3b63a34e12be None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:02.299721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68d73-a6d1-4da9-994e-3b63a34e12be None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:02.300211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68d73-a6d1-4da9-994e-3b63a34e12be None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:02.302190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 674/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 06:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:02.311474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ce8d-198b-4e3f-b270-3e801a2328cf None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:02.312385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ce8d-198b-4e3f-b270-3e801a2328cf None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:02.312918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ce8d-198b-4e3f-b270-3e801a2328cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:02.408675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2804ce8d-198b-4e3f-b270-3e801a2328cf None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:02.410379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2804ce8d-198b-4e3f-b270-3e801a2328cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:02.535841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 677/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 06:53:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:53:06.652703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f82243-d9b1-47f3-9989-bc396a1d6832 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:06.653594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f82243-d9b1-47f3-9989-bc396a1d6832 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:06.653876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f82243-d9b1-47f3-9989-bc396a1d6832 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:06.655388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 675/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 06:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:53:06.660221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd431a-d27c-44b4-8889-0277f87a90d7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:06.661079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd431a-d27c-44b4-8889-0277f87a90d7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:06.661607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd431a-d27c-44b4-8889-0277f87a90d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:06.691811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=59 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:06.725697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:06.751963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-44cd431a-d27c-44b4-8889-0277f87a90d7 None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:06.753236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-44cd431a-d27c-44b4-8889-0277f87a90d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:06.865485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 678/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 06:53:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:08.304219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b55e-33f5-4ad8-a24f-742c34fedcfc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:08.304751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b55e-33f5-4ad8-a24f-742c34fedcfc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:08.304751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b55e-33f5-4ad8-a24f-742c34fedcfc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:08.306052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 676/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 06:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:08.311608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d9f-1efa-438b-9b4a-92d7c01dfdac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:08.312016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d9f-1efa-438b-9b4a-92d7c01dfdac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:08.312151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d9f-1efa-438b-9b4a-92d7c01dfdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:08.389550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-894d8d9f-1efa-438b-9b4a-92d7c01dfdac None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:08.390855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-894d8d9f-1efa-438b-9b4a-92d7c01dfdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:08.436338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:08.500340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 679/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 06:53:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:12.123035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7ad5-a949-4c37-8378-8e341929e443 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:12.123557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7ad5-a949-4c37-8378-8e341929e443 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:12.123658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7ad5-a949-4c37-8378-8e341929e443 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:12.124945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 677/1356] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:12.130263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d26-5d25-4255-bd91-866da28f392d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:12.130675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d26-5d25-4255-bd91-866da28f392d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:12.130809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc106d26-5d25-4255-bd91-866da28f392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:12.202830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-dc106d26-5d25-4255-bd91-866da28f392d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:12.204099 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc106d26-5d25-4255-bd91-866da28f392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:12.307350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 680/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:12.615072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:12.615662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:12.616217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:12.618586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 678/1358] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 06:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:12.628221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb970-9a1c-4dbe-8252-57ec1a10bf6b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:12.628775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb970-9a1c-4dbe-8252-57ec1a10bf6b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:12.629270 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb970-9a1c-4dbe-8252-57ec1a10bf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:12.653631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:12.719509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8c0eb970-9a1c-4dbe-8252-57ec1a10bf6b None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:12.720810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8c0eb970-9a1c-4dbe-8252-57ec1a10bf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:12.853504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 681/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 06:53:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:12.861285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:12.862945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:13.033528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19ee00-5064-4501-b4e3-98ee2d74badf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:13.110538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:13.152910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:13.154328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:13.154608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:13.154882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:13.156803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:13.258365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:13.260695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84d1a-bdb0-4f8f-821f-5d2d249d821b service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:13.280062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 679/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:53:15.688656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:15.689105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:15.689200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:15.690720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 682/1361] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:15.695850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432df78-91fb-40af-b6b7-3e82dbad4866 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:15.696241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432df78-91fb-40af-b6b7-3e82dbad4866 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:15.696438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432df78-91fb-40af-b6b7-3e82dbad4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:15.769014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d432df78-91fb-40af-b6b7-3e82dbad4866 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:15.770304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d432df78-91fb-40af-b6b7-3e82dbad4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:15.809208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:15.868983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 680/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:16.161106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:16.164703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:16.256541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:16.359363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddcd2-eaf0-4b01-89e9-c71afc726953 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:16.494698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:16.495223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:16.495498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:16.495778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:16.497408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:16.520412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:16.593032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:16.594639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23709c85-7637-451f-8b72-217856ef6fc0 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:16.614111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 683/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:19.137397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e664-27bf-4e0f-b247-c86574309cdb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:19.137981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e664-27bf-4e0f-b247-c86574309cdb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:19.137981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e664-27bf-4e0f-b247-c86574309cdb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:19.139268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 681/1364] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:19.144609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdebe-eef2-478e-afad-4045a0edc619 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:19.145027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdebe-eef2-478e-afad-4045a0edc619 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:19.145240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fdebe-eef2-478e-afad-4045a0edc619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:19.220983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-184fdebe-eef2-478e-afad-4045a0edc619 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:19.223017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-184fdebe-eef2-478e-afad-4045a0edc619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:19.327719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:19.340915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 684/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:19.622995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:19.623391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:19.623778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:19.625639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 682/1366] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 06:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:19.630801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cc6c-53b8-4363-8b85-6f710644082a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:19.631186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cc6c-53b8-4363-8b85-6f710644082a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:19.631583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cc6c-53b8-4363-8b85-6f710644082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:19.712093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c2a1cc6c-53b8-4363-8b85-6f710644082a None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:19.713506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c2a1cc6c-53b8-4363-8b85-6f710644082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:19.835846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 685/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 06:53:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:19.844437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:19.846053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:20.015409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267100-3ac8-42fe-a8f3-9df59640622a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:20.040536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:20.141434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:20.142769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:20.143040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:20.143306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:20.144940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:20.252522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:20.254195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5fac3-5f8b-40c0-a6cc-4d7249a713f2 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:20.275242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 683/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:20.349466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babcef-e6ee-4da6-93d6-17adc766992e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:20.350479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babcef-e6ee-4da6-93d6-17adc766992e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:20.350748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babcef-e6ee-4da6-93d6-17adc766992e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:20.352491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 686/1369] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:20.358601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715608-849e-4ada-bf6b-407e99760e6e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:20.359169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715608-849e-4ada-bf6b-407e99760e6e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:20.359773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69715608-849e-4ada-bf6b-407e99760e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:20.397915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:20.446235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-69715608-849e-4ada-bf6b-407e99760e6e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:20.448661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-69715608-849e-4ada-bf6b-407e99760e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:20.572557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 684/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:20.940917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:20.940917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:20.940917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:20.943425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 687/1371] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 13 06:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:20.946680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c768940-9f3a-48f5-87d6-ef3e17150f9a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:20.946967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c768940-9f3a-48f5-87d6-ef3e17150f9a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:20.947236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c768940-9f3a-48f5-87d6-ef3e17150f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:21.047427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1c768940-9f3a-48f5-87d6-ef3e17150f9a None None] MFA Rules not processed for user `bc9bfa0fb8ee4875a6a9b24607e6a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:21.048787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1c768940-9f3a-48f5-87d6-ef3e17150f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:21.100098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:21.132769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 685/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 13 06:53:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:21.141457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:21.143071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:21.211458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:21.265717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87f3f-a867-4de1-b22b-18df2cf4b8b1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:21.389342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:21.390084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:21.390431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:21.390618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:21.392083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:21.498741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:21.513728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:21.515105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346e276-a84b-4cc9-becf-4d443e917146 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:21.544722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 688/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:22.554949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:22.555549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:22.555549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:22.557002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 686/1374] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:22.562477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b73d-684d-4749-a883-fb35d6a73600 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:22.562881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b73d-684d-4749-a883-fb35d6a73600 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:22.563173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b73d-684d-4749-a883-fb35d6a73600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:22.629164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c8b6b73d-684d-4749-a883-fb35d6a73600 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:22.630477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c8b6b73d-684d-4749-a883-fb35d6a73600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:22.728743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 689/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:23.045841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:23.047449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:23.213674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91358a9b-5ee4-422b-b927-764537ee5749 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:23.267208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:23.331259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:23.332063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:23.332455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:23.332901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:23.334510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:23.426746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:23.428655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7de757-6816-47b2-93f9-5bfd526ce202 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:23.447466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 687/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:25.652456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:25.653075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:25.653075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:25.656947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 690/1377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:25.659552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0aa8-d40e-47a3-a5ba-577be16ae289 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:25.659953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0aa8-d40e-47a3-a5ba-577be16ae289 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:25.660163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0aa8-d40e-47a3-a5ba-577be16ae289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:25.730835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-283a0aa8-d40e-47a3-a5ba-577be16ae289 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:25.732045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-283a0aa8-d40e-47a3-a5ba-577be16ae289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:25.739202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:25.840429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 688/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:53:26.129002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:26.130725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:26.217579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:26.316079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f05de-4d38-4b96-a51f-f0a668907bb9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:26.437907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:26.438513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:26.438799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:26.439070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:26.440847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:26.462783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:26.547921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:26.549771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f2ad-9d8b-4541-9e21-c470bef72284 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:26.570453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 691/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:28.819098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:28.819568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:28.819676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:28.820996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 689/1380] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:28.826993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b79a6-39e2-4e2f-b9cb-0a4f8dc0868a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:28.827404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b79a6-39e2-4e2f-b9cb-0a4f8dc0868a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:28.827573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b79a6-39e2-4e2f-b9cb-0a4f8dc0868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:28.898368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-744b79a6-39e2-4e2f-b9cb-0a4f8dc0868a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:28.900274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-744b79a6-39e2-4e2f-b9cb-0a4f8dc0868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:29.006767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:29.026998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 692/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:53:29.332342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:29.334370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:29.486120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:29.500084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd784c04-3407-4c5d-b7e2-8b765a135a85 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:29.626885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:29.627414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:29.627688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:29.627957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:29.629583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:29.723234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:29.724875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3732c-365a-4dd4-bc54-3e533cf933e6 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:29.735898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:29.745533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 690/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:32.169807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:32.170527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:32.170527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:32.171681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 693/1383] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:32.177005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754926d-917b-418c-a7c7-dc4ad25d83e7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:32.177703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754926d-917b-418c-a7c7-dc4ad25d83e7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:32.177812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754926d-917b-418c-a7c7-dc4ad25d83e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:32.248113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2754926d-917b-418c-a7c7-dc4ad25d83e7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:32.249815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2754926d-917b-418c-a7c7-dc4ad25d83e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:32.356239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 691/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:32.643767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:32.645840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:32.829346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b2ef-f831-48b9-b0d4-291c4911c8cc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:32.904105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:32.952639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:32.953249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:32.953564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:32.953793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:32.955406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:33.059421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:33.061520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b195c73-f0ed-4801-8c48-ee5316c34ce1 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:33.084407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 694/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:35.627185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:35.627755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:35.627755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:35.629094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 692/1386] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:35.635229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775eb6a-b87e-40e0-b2a9-dd9552c80b0f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:35.635640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775eb6a-b87e-40e0-b2a9-dd9552c80b0f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:35.635846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775eb6a-b87e-40e0-b2a9-dd9552c80b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:35.703321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8775eb6a-b87e-40e0-b2a9-dd9552c80b0f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:35.704527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8775eb6a-b87e-40e0-b2a9-dd9552c80b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:35.737162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:35.802776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 695/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:36.092801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:36.094330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:36.171726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:36.243339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209776c-0f7a-411a-8fe2-003b7dfb8fce None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:36.365742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:36.366252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:36.366531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:36.366802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:36.368661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:36.407919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:36.460263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:36.461945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba97e-67aa-4043-b119-a5fb790e4061 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:36.479777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 693/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:36.840860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bab543-8f38-4998-8499-40018ff5af97 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:36.841432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bab543-8f38-4998-8499-40018ff5af97 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:36.841432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bab543-8f38-4998-8499-40018ff5af97 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:36.842746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 696/1389] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:53:36.847987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aff0d-6471-4d9b-afe0-19bbe1526fb1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:36.848420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aff0d-6471-4d9b-afe0-19bbe1526fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:36.848640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aff0d-6471-4d9b-afe0-19bbe1526fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:36.916909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-114aff0d-6471-4d9b-afe0-19bbe1526fb1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:36.918130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-114aff0d-6471-4d9b-afe0-19bbe1526fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:37.020722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 694/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:37.325914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:37.326196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:37.326498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:37.327835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 697/1391] 10.222.0.48 () {54 vars in 966 bytes} [Tue Sep 13 06:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:37.333171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b22-e666-4c48-be38-ae783a941abf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:37.333547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b22-e666-4c48-be38-ae783a941abf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:37.333829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b22-e666-4c48-be38-ae783a941abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:37.349668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:37.413817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9b393b22-e666-4c48-be38-ae783a941abf None None] MFA Rules not processed for user `d52d02c55ffa409d85cdbffa7c30e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:37.415604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9b393b22-e666-4c48-be38-ae783a941abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:37.489636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 695/1392] 10.222.0.48 () {58 vars in 1063 bytes} [Tue Sep 13 06:53:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:37.499175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:37.500706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:37.606328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce2e7a-0a96-404f-86c1-b6b262a37cc1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:37.668186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:37.684920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:37.685528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:37.685807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:37.686083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:37.687674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:37.796150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:37.797888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f4cf5-fbc6-4a9d-8419-7beb571330dc service glance] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:37.816736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 698/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:38.575758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b046-656e-41e7-9392-a2dc1cea2299 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:38.576246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b046-656e-41e7-9392-a2dc1cea2299 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:38.576354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764b046-656e-41e7-9392-a2dc1cea2299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:38.652294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e764b046-656e-41e7-9392-a2dc1cea2299 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:38.653541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e764b046-656e-41e7-9392-a2dc1cea2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:38.715393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:38.720267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a72fd-d0c8-44c6-83b0-56b95cd061e4 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:38.720867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a72fd-d0c8-44c6-83b0-56b95cd061e4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:38.720968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a72fd-d0c8-44c6-83b0-56b95cd061e4 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:38.722882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 699/1394] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:53:38.728502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:38.728973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:38.729245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:38.749128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 696/1395] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:38.797857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7941-c2e5-43ed-abb7-823e3f9f0613 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:38.798228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7941-c2e5-43ed-abb7-823e3f9f0613 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:38.798507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7941-c2e5-43ed-abb7-823e3f9f0613 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:38.798664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:38.799878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 697/1396] 10.222.0.48 () {54 vars in 943 bytes} [Tue Sep 13 06:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:53:38.800032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:38.806919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:38.807203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:38.807478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:38.844012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:38.887553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] MFA Rules not processed for user `421252e103f1435286c0f3b84442c6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:38.888801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:38.901899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 700/1397] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:53:38.996707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 698/1398] 10.222.0.48 () {58 vars in 1040 bytes} [Tue Sep 13 06:53:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:53:39.006486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:39.007706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:39.113594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc779f01-4f5b-445b-95d3-b7e2282bc3a7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:39.177631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:39.204365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:39.205619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:39.219959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:39.220567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:39.220869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:39.221140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:39.222792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:39.239938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:39.305944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446547f-26f2-4bbf-984b-d0cc146389ac None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:39.308905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:39.310510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489415a3-0166-4218-9e33-3140f47b7985 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:39.318843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 701/1399] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 06:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:53:39.427759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:39.428379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:39.428687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:39.428958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:39.431133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:39.483874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:39.541282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:39.542680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41d7e4-4ad7-4c89-8a76-5b40e85f578e service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:39.563106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 699/1400] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:53:41.839459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:41.840048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:41.840048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:41.841346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 702/1401] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:41.846568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527e82-e66f-4873-9978-dfd9ac8f76e6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:41.847011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527e82-e66f-4873-9978-dfd9ac8f76e6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:41.847102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527e82-e66f-4873-9978-dfd9ac8f76e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:41.921196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-50527e82-e66f-4873-9978-dfd9ac8f76e6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:41.922317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50527e82-e66f-4873-9978-dfd9ac8f76e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:42.033420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 700/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:42.327738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:42.329295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:42.444081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:42.498764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458871-eec1-44a9-9fc6-909647a25248 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:42.620401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:42.620978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:42.621261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:42.621687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:42.623317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:42.697187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:42.728686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:42.730312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10235d-116b-46ba-a38a-72575e3d13f3 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:42.752781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 703/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:44.991844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:44.998201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:44.998561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:45.000201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 701/1404] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:45.006334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b975-28a8-4341-88fd-e2279e15717a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:45.007415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b975-28a8-4341-88fd-e2279e15717a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:45.007768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b975-28a8-4341-88fd-e2279e15717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:45.091490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6a27b975-28a8-4341-88fd-e2279e15717a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:45.092910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6a27b975-28a8-4341-88fd-e2279e15717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:45.208646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 704/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:45.499969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:45.502758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:45.528005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:45.678992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bbd69-e27a-4ee8-bdb6-fafc210b0202 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:45.782353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:45.811306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:45.812051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:45.812330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:45.812617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:45.814246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:45.921547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:45.923725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f1f4-8161-405c-84ea-8f099403a1e7 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:45.948604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 702/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:48.265040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:48.265040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:48.265519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:48.266777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 705/1407] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:53:48.272198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5f75-dbd5-49d8-882b-af0c4b1437e0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:48.272798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5f75-dbd5-49d8-882b-af0c4b1437e0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:48.272798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5f75-dbd5-49d8-882b-af0c4b1437e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:48.349440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3f2f5f75-dbd5-49d8-882b-af0c4b1437e0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:53:48.350617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3f2f5f75-dbd5-49d8-882b-af0c4b1437e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:48.411167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:48.463083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 703/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:53:48.756606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:53:48.758151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:48.809880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:48.926818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce2541-0163-4c1b-95c7-98040ae57079 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:53:49.063975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:53:49.064646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:53:49.064922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:53:49.065188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:53:49.066852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:53:49.069284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:49.166870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:53:49.168477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6353-1f85-4f16-80d6-c8f6181e97fe service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:53:49.189811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 706/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:53:58.458446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=19 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:53:59.187399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=44 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:02.396755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c5d3-c9ae-481d-9a9b-e29ec906b92a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:02.397315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c5d3-c9ae-481d-9a9b-e29ec906b92a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:02.397315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c5d3-c9ae-481d-9a9b-e29ec906b92a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:02.399216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 704/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 13 06:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:02.404265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db13e8e-5cff-45ac-a16a-a2dd98bb63b3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:02.404744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db13e8e-5cff-45ac-a16a-a2dd98bb63b3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:02.404860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db13e8e-5cff-45ac-a16a-a2dd98bb63b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:02.480662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2db13e8e-5cff-45ac-a16a-a2dd98bb63b3 None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:02.481864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2db13e8e-5cff-45ac-a16a-a2dd98bb63b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:02.585895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 707/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 13 06:54:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:02.600347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a9b3-532e-4794-8e60-cb116576e743 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:02.600666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a9b3-532e-4794-8e60-cb116576e743 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:02.600944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a9b3-532e-4794-8e60-cb116576e743 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:02.602967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 705/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 13 06:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:02.607823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934437d-38a3-4aeb-a0f4-5c6f552e0ffe None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:02.608111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934437d-38a3-4aeb-a0f4-5c6f552e0ffe None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:02.608388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934437d-38a3-4aeb-a0f4-5c6f552e0ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:02.681544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:02.685061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e934437d-38a3-4aeb-a0f4-5c6f552e0ffe None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:02.686821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e934437d-38a3-4aeb-a0f4-5c6f552e0ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:02.800982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 708/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 13 06:54:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:05.403297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:05.403810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:05.403810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:05.405138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:05.410419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f62c26-5e19-43f6-8cda-015c916f05f0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:05.410841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f62c26-5e19-43f6-8cda-015c916f05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:05.410962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f62c26-5e19-43f6-8cda-015c916f05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:05.475907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-38f62c26-5e19-43f6-8cda-015c916f05f0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:05.477689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-38f62c26-5e19-43f6-8cda-015c916f05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:05.531136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:05.573844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:05.873265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:05.874849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:06.021915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1abd92-6dcb-4d18-88a1-aad34f162c9f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:06.095591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:06.135909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:06.136438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:06.136736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:06.137000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:06.138598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:06.230191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:06.231783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28402d93-50fe-42cd-b158-86a3f3a3abef service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:06.249916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 707/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:07.392603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:07.393118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:07.393118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:07.394461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:07.401162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb67e9-969e-4c57-838d-389eeaaa2795 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:07.401595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb67e9-969e-4c57-838d-389eeaaa2795 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:07.401691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb67e9-969e-4c57-838d-389eeaaa2795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:07.477681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-49eb67e9-969e-4c57-838d-389eeaaa2795 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:07.478881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-49eb67e9-969e-4c57-838d-389eeaaa2795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:07.505547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:07.577232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:07.733151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:07.734592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:07.885385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab48903-9d10-4f4e-88a4-7d4fde92cc5a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:07.925077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:07.997746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:07.998344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:07.998618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:07.998884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:08.000469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:08.091318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:08.092936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f1cef-33d0-45e0-8d51-8b70da54440a service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:08.110602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 711/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:09.247872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:09.248442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:09.248442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:09.249887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:09.256111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98a1a9-f855-4c97-9c99-e7457e261aa4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:09.256532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98a1a9-f855-4c97-9c99-e7457e261aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:09.256695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98a1a9-f855-4c97-9c99-e7457e261aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:09.310111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:09.331914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0e98a1a9-f855-4c97-9c99-e7457e261aa4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:09.333132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0e98a1a9-f855-4c97-9c99-e7457e261aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:09.429446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:09.582348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:09.583812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:09.731974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f2b0-08d3-41ea-b083-e8dffac71b68 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:09.745001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:09.847037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:09.847559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:09.847837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:09.848106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:09.849748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:09.938431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:09.940011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5202ef9-fd2e-4305-b17d-69bd9e3977b4 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:09.958106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 710/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:11.074650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:11.075132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:11.075228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:11.076547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:11.083104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65313-3641-4a7c-9474-ef80488898fc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:11.083590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65313-3641-4a7c-9474-ef80488898fc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:11.083691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65313-3641-4a7c-9474-ef80488898fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:11.106664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:11.163200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c3e65313-3641-4a7c-9474-ef80488898fc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:11.164410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c3e65313-3641-4a7c-9474-ef80488898fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:11.262124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:11.413527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:11.415060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:11.524901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:11.561838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc96c-6bf6-48cb-a74f-34c5f6e0d84d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:11.676288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:11.676956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:11.677257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:11.677774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:11.679447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:11.756423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:11.769903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:11.771499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9a95d-3407-4173-9a09-bb40bcc3f665 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:11.790353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 714/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:12.910486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:12.911085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:12.911085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:12.912406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:12.919414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5625ae-68cc-43ec-9cf5-08f406966575 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:12.919924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5625ae-68cc-43ec-9cf5-08f406966575 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:12.920093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5625ae-68cc-43ec-9cf5-08f406966575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:12.997198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ca5625ae-68cc-43ec-9cf5-08f406966575 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:12.998395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ca5625ae-68cc-43ec-9cf5-08f406966575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:13.094894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:13.252038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:13.253614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:13.337467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:13.398188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a970a-8b3c-4de7-a8ba-b352cf0e3525 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:13.510327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:13.510856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:13.511130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:13.511396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:13.513029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:13.563933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:13.605431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:13.607022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ee4bb-d3f4-4b85-aba9-fc2ca9a5ab11 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:13.625224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 713/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:14.686851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:14.687464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:14.687464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:14.688737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:14.694891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be9f7-0ea7-4869-ae00-34d2d7e6c9a2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:14.695442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be9f7-0ea7-4869-ae00-34d2d7e6c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:14.695442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be9f7-0ea7-4869-ae00-34d2d7e6c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:14.772389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-265be9f7-0ea7-4869-ae00-34d2d7e6c9a2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:14.773627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-265be9f7-0ea7-4869-ae00-34d2d7e6c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:14.872139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:15.023472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:15.025651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:15.073400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:15.172330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01804-b299-4cc2-ac47-456674a9df90 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:15.283728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:15.284326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:15.284619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:15.284889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:15.286466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:15.293419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:15.377188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:15.378801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808c09e-9713-461f-b780-700f68cec161 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:15.397360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 717/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:16.460525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:16.461108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:16.461108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:16.462941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:16.469323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c1a5-bcfe-4a9d-a9cf-2e184d2abc20 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:16.469761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c1a5-bcfe-4a9d-a9cf-2e184d2abc20 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:16.469874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c1a5-bcfe-4a9d-a9cf-2e184d2abc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:16.548903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ef02c1a5-bcfe-4a9d-a9cf-2e184d2abc20 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:16.550033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ef02c1a5-bcfe-4a9d-a9cf-2e184d2abc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:16.623303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:16.653281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:54:16.803351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:16.804831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:16.824057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:16.955473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b810b-2870-4f44-92a9-7c575435f548 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:17.044306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:17.071181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:17.072376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:17.072688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:17.072956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:17.074531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:17.163392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:17.165081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fa2a2-fc08-4fd3-9d51-ba25e82e6edd service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:17.183785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 716/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:54:18.248147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:18.248744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:18.248744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:18.250056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:18.256444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42acd4-3a64-4e2b-b4ff-a56bc95cad38 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:18.256892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42acd4-3a64-4e2b-b4ff-a56bc95cad38 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:18.257033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42acd4-3a64-4e2b-b4ff-a56bc95cad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:18.333360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fa42acd4-3a64-4e2b-b4ff-a56bc95cad38 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:18.334553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fa42acd4-3a64-4e2b-b4ff-a56bc95cad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:18.377468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:18.432304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:18.582237 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:18.583670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:18.728692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d548088-36c0-4e89-a222-f343dc115234 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:18.783189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:18.842783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:18.843311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:18.843590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:18.843861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:18.845493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:18.935565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:18.937239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488f448-c025-4658-ad83-1ad2c071f03b service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:18.955284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 720/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:20.012326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:20.012890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:20.012890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:20.014228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:20.020755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db972caa-551d-4ad3-9761-d1022494e7bf None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:20.021228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db972caa-551d-4ad3-9761-d1022494e7bf None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:20.021322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db972caa-551d-4ad3-9761-d1022494e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:20.097596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-db972caa-551d-4ad3-9761-d1022494e7bf None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:20.098804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-db972caa-551d-4ad3-9761-d1022494e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:20.100780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:20.195421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:20.345090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:20.346598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:20.490035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316bef6-e938-4ade-840e-df077f0efc1e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:20.517411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:20.602586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:20.603156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:20.603429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:20.603690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:20.605315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:20.695087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:20.697716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206beb-86af-48a1-8655-0789d268b81b service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:20.715700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 719/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:22.787017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:22.787593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:22.787593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:22.788911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:22.794675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c20e-9933-4fdf-adb5-9179188024c7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:22.795122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c20e-9933-4fdf-adb5-9179188024c7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:22.795239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c20e-9933-4fdf-adb5-9179188024c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:22.847246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:22.874343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c611c20e-9933-4fdf-adb5-9179188024c7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:22.875541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c611c20e-9933-4fdf-adb5-9179188024c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:22.971495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:23.264443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:23.266063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:23.368490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dcbd-8ef2-4f9e-b303-7ec539f92987 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:23.400981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:23.443081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:23.443688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:23.443964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:23.444232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:23.445925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:23.561769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:23.563125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e536c1b-7ca2-43be-b70b-985ab2fd1d5a service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:23.581276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 723/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:25.990914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:25.991508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:25.991508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:25.992869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:25.998723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008107ef-769e-467e-ae6b-ebd7afb29ea3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:25.999120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008107ef-769e-467e-ae6b-ebd7afb29ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:25.999273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008107ef-769e-467e-ae6b-ebd7afb29ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:26.067146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-008107ef-769e-467e-ae6b-ebd7afb29ea3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:26.068353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-008107ef-769e-467e-ae6b-ebd7afb29ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:26.081282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:26.164927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:26.463102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:26.465243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:26.567731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2af4e-b09d-4212-b94b-a29994410b91 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:26.581061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:26.643227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:26.643832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:26.644112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:26.644385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:26.646015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:26.755874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:26.757358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65f85a-2efd-45ae-b63e-1f7370cebdf4 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:26.775898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 722/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:29.282062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:29.282611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:29.282611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:29.283859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:29.289366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d0ba-f546-4551-93dc-499fdaef1586 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:29.289804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d0ba-f546-4551-93dc-499fdaef1586 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:29.289911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d0ba-f546-4551-93dc-499fdaef1586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:29.339540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:29.357575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-97c8d0ba-f546-4551-93dc-499fdaef1586 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:29.358794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-97c8d0ba-f546-4551-93dc-499fdaef1586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:29.454760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:54:29.739374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:29.740932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:29.843980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee791030-d8c6-4cce-8f30-947e70f0d371 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:29.883823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:29.918173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:29.918777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:29.919056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:29.919329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:29.920966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:30.029735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:30.031159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f85a-a5cd-4ecf-b524-4c864f5dafad service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:30.048953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 726/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:32.318867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:32.319325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:32.319428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:32.320787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:32.326297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ca72-a702-4e02-b3e6-d0cb3b43725d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:32.326711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ca72-a702-4e02-b3e6-d0cb3b43725d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:32.326861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657ca72-a702-4e02-b3e6-d0cb3b43725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:32.391830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7657ca72-a702-4e02-b3e6-d0cb3b43725d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:32.393081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7657ca72-a702-4e02-b3e6-d0cb3b43725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:32.414340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:32.493400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:32.781544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:32.783125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:32.890447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b327fe-75f9-4270-aa71-00a726e320f0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:32.909834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:32.963216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:32.963840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:32.964252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:32.964523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:32.966166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:33.074794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:33.076155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85baa9a-9688-4757-9cf4-34f6adb43e5f service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:33.093684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 725/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:35.375934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:35.376461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:35.376461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:35.377744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:35.382942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e093-5b89-46e3-a52c-f0f6738c087e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:35.383343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e093-5b89-46e3-a52c-f0f6738c087e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:35.383484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e093-5b89-46e3-a52c-f0f6738c087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:35.447972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:35.450768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6eb8e093-5b89-46e3-a52c-f0f6738c087e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:35.452624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6eb8e093-5b89-46e3-a52c-f0f6738c087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:35.548398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:35.839303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:35.840860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:35.943757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50adbe8-0d1e-445d-83bf-07cd288cc5c7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:35.993183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:36.018187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:36.018788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:36.019068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:36.019334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:36.020939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:36.127356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:36.128724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282088a2-efb1-4e33-8473-d3f4c13554a9 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:36.146570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 729/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:38.504603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:38.505136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:38.505255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:38.506497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:54:38.512368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3c2f-447a-41f4-8d4f-012a0bd714b0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:38.512845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3c2f-447a-41f4-8d4f-012a0bd714b0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:38.512954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a3c2f-447a-41f4-8d4f-012a0bd714b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:38.585028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e32a3c2f-447a-41f4-8d4f-012a0bd714b0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:38.586157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e32a3c2f-447a-41f4-8d4f-012a0bd714b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:38.614611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:38.684544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:38.969005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:38.970575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:39.076402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e499bf-4aa0-4931-a94a-122c0d76c5a2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:39.105180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:39.150114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:39.150794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:39.151079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:39.151349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:39.152978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:39.262258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:39.263681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e179a-189b-477f-86b6-b2d3b5fc5269 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:39.281769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 728/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:41.515599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:41.516129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:41.516129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:41.517492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:41.522866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfede7-ca88-4e6c-bad6-116adcc00f2f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:41.523291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfede7-ca88-4e6c-bad6-116adcc00f2f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:41.523413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfede7-ca88-4e6c-bad6-116adcc00f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:41.591176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0dcfede7-ca88-4e6c-bad6-116adcc00f2f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:41.592370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0dcfede7-ca88-4e6c-bad6-116adcc00f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:41.600552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:41.692473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:41.985183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:41.986774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:42.089892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccf7d6-f18c-409f-9224-50134e36aef7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:42.144247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:42.162448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:42.163055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:42.163333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:42.163605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:42.165222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:42.271888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:42.273345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c6263-7f67-4ee9-a998-59a2cdb00390 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:42.290803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 732/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:44.527358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:44.527954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:44.527954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:44.529260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:44.534520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbe39-b0a6-487c-8b7e-e0ed52742b76 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:44.534931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbe39-b0a6-487c-8b7e-e0ed52742b76 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:44.535068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbe39-b0a6-487c-8b7e-e0ed52742b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:44.603130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-295fbe39-b0a6-487c-8b7e-e0ed52742b76 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:44.604992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-295fbe39-b0a6-487c-8b7e-e0ed52742b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:44.643229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:44.701095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:44.987354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:44.988962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:45.093248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e9fd-8bf3-4c00-b9d3-54c63e5ad93b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:45.130691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:45.166976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:45.167576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:45.167848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:45.168112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:45.169732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:45.280919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:45.282373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f916c17-b7d3-4626-8384-9d858ee9ea39 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:45.300129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 731/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:47.538593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:47.539170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:47.539170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:47.540478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:47.545881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdadf1-2aaa-4599-8a04-cad12f5e5813 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:47.546306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdadf1-2aaa-4599-8a04-cad12f5e5813 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:47.546420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdadf1-2aaa-4599-8a04-cad12f5e5813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:47.612529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ddbdadf1-2aaa-4599-8a04-cad12f5e5813 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:47.613754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ddbdadf1-2aaa-4599-8a04-cad12f5e5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:47.632085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:47.717279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:48.018365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:48.019912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:48.129565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac051-6035-4c8e-8508-68d4fbd8557d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:48.196871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:48.204457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:48.205121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:48.205408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:48.205701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:48.207357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:48.317065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:48.318517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a192a-0e91-44ef-a012-5012a4367586 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:48.336291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 735/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:54:50.516153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:50.516744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:50.516744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:50.518072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:54:50.523375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6027-b3c4-4a25-a141-cf95f6253fac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:50.523801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6027-b3c4-4a25-a141-cf95f6253fac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:50.523918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d6027-b3c4-4a25-a141-cf95f6253fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:50.590402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7c4d6027-b3c4-4a25-a141-cf95f6253fac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:54:50.591520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7c4d6027-b3c4-4a25-a141-cf95f6253fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:50.638524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:50.688058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:54:50.971375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:54:50.972952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:51.076316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398f5c9-3d0c-4e77-8411-27ce4686293f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:54:51.124850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:54:51.153581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:54:51.154199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:54:51.154476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:54:51.154809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:54:51.156998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:54:51.266437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:54:51.267881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4762-724a-475f-a054-b1dba8e7a64e service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:54:51.286035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 734/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:00.686646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=22 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:01.283849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=66 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:12.068105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64fc0-ec43-42ad-a7d6-06df9e8ff665 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:12.068670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64fc0-ec43-42ad-a7d6-06df9e8ff665 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:12.068670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64fc0-ec43-42ad-a7d6-06df9e8ff665 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:12.070022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 737/1471] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:12.076338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b3ba-a389-444b-a456-612bb962a8c4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:12.076756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b3ba-a389-444b-a456-612bb962a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:12.076915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b3ba-a389-444b-a456-612bb962a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:12.143919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5e81b3ba-a389-444b-a456-612bb962a8c4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:12.145146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5e81b3ba-a389-444b-a456-612bb962a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:12.242801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 735/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:12.555691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:12.555958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:12.556759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:12.558081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 738/1473] 10.222.0.48 () {54 vars in 966 bytes} [Tue Sep 13 06:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:12.563145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b2ad-f3b2-4312-9d4b-90b9d841cb1f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:12.563397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b2ad-f3b2-4312-9d4b-90b9d841cb1f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:12.563664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b2ad-f3b2-4312-9d4b-90b9d841cb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:12.638450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dd29b2ad-f3b2-4312-9d4b-90b9d841cb1f None None] MFA Rules not processed for user `d52d02c55ffa409d85cdbffa7c30e00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:12.639632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dd29b2ad-f3b2-4312-9d4b-90b9d841cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:12.659722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:12.715673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 736/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Tue Sep 13 06:55:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:55:12.723603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:12.725588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:12.828412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a687e-e140-4f84-9903-349bacd6e59a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:12.901899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:12.902500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:12.902772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:12.903032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:12.904663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:12.962276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:13.017034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:13.018555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b1c5e-bed3-4f27-8ed4-48ae8cd8f46c service glance] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:13.037919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 739/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:15.317766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:15.318322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:15.318322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:15.319602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 737/1476] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:15.325051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d431ce-e478-44e9-b3e4-f5c3ffdfd0bd None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:15.325466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d431ce-e478-44e9-b3e4-f5c3ffdfd0bd None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:15.325595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d431ce-e478-44e9-b3e4-f5c3ffdfd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:15.390214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c4d431ce-e478-44e9-b3e4-f5c3ffdfd0bd None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:15.391408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c4d431ce-e478-44e9-b3e4-f5c3ffdfd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:15.491030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 740/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:15.766851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:15.768410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:15.893719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dd593-7788-429b-9098-ef215abba85a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:15.943526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:15.986864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:15.987461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:15.987738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:15.988006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:15.988661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:15.990461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:55:15.990461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 06:55:15.990461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 06:55:15.991618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662b6f-3bcd-43dd-9cb9-640fe8c8cf69 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:16.010824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 738/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 06:55:15 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:55:18.187410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:18.188080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:18.188080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:18.189309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 741/1479] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:18.194540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba7ac-fa34-48a3-a4e9-7d7dbf18b854 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:18.194974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba7ac-fa34-48a3-a4e9-7d7dbf18b854 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:18.195097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba7ac-fa34-48a3-a4e9-7d7dbf18b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:18.262104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-541ba7ac-fa34-48a3-a4e9-7d7dbf18b854 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:18.263323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-541ba7ac-fa34-48a3-a4e9-7d7dbf18b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:18.359437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 739/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:18.680424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:18.682525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:18.692340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:18.829692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98659780-87cf-4872-b0ca-58dcbdfd849b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:18.908174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:18.941908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:18.942444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:18.942719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:18.942987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:18.944621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:19.032088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:19.033719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307cf0e-c9a8-4828-b787-478909b610c8 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:19.051778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 742/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:21.371305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:21.371832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:21.371832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:21.373159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 740/1482] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:21.378440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0974cb-b74d-4301-85ff-d715fc4711e1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:21.378862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0974cb-b74d-4301-85ff-d715fc4711e1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:21.378993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0974cb-b74d-4301-85ff-d715fc4711e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:21.445076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0a0974cb-b74d-4301-85ff-d715fc4711e1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:21.446270 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0a0974cb-b74d-4301-85ff-d715fc4711e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:21.496986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:21.551384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 743/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:21.839453 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:21.841069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:21.865062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:21.946058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011a4b7-035a-4bd7-903e-39f3cca161a5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:22.139209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:22.139725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:22.139999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:22.140267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:22.141882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:22.218648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:22.254919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:22.256348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753dfac-ec09-45d8-a850-1e1f02168eb1 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:22.274406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 741/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:24.501014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:24.501606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:24.501606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:24.502966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 744/1485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:24.508335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f364-b9c1-4c81-89c3-3b6be30718f7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:24.508772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f364-b9c1-4c81-89c3-3b6be30718f7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:24.508970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f364-b9c1-4c81-89c3-3b6be30718f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:24.576340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7d93f364-b9c1-4c81-89c3-3b6be30718f7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:24.577491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7d93f364-b9c1-4c81-89c3-3b6be30718f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:24.676114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 742/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:24.966637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:24.968181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:25.072055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea93f-be55-4b74-8a82-d2445bfccea3 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:25.144910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:25.146366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:25.147005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:25.147513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:25.147813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:25.150014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:25.257067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:25.258498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1247f-c9e7-4285-9a76-819965becc3e service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:25.276882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 745/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:27.576187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:27.576780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:27.576780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:27.578150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 743/1488] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:27.583600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8077f-b4db-47e6-aa56-6a5a161f1bba None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:27.584004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8077f-b4db-47e6-aa56-6a5a161f1bba None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:27.584141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8077f-b4db-47e6-aa56-6a5a161f1bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:27.653738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-46b8077f-b4db-47e6-aa56-6a5a161f1bba None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:27.654933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-46b8077f-b4db-47e6-aa56-6a5a161f1bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:27.707209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:27.752275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 746/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:28.047821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:28.049381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:28.087692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:28.155703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b5ff8-148e-471b-b026-2eec47c97e52 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:28.230114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:28.230709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:28.230980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:28.231265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:28.232850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:28.311603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:28.341100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:28.342542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b409939-3549-4a08-9141-1e7dcb8a3b9d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:28.360676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 744/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:30.696069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:30.697181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:30.697181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:30.698532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 747/1491] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 06:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:55:30.703733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb672-b6e1-41b6-b0a7-09afd6cc5608 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:30.704129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb672-b6e1-41b6-b0a7-09afd6cc5608 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:30.704279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb672-b6e1-41b6-b0a7-09afd6cc5608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:30.774225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-844cb672-b6e1-41b6-b0a7-09afd6cc5608 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:55:30.776724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-844cb672-b6e1-41b6-b0a7-09afd6cc5608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:30.873277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 745/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 06:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:55:31.169864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:55:31.171418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:31.277656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c050efc-db9a-4d40-9648-97e36262720e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:55:31.352210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:55:31.352874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:55:31.353376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:55:31.353645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:55:31.355268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:55:31.363922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:31.581533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:55:31.582875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fac6a-ef05-4766-b20c-5de559789e7c service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:55:31.601213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 748/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:55:40.871749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=82 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:55:41.598936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=50 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:45.781845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:45.782525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:45.782525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:45.857053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:56:45.858238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:45.958569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 746/1494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 06:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:56:45.966601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:45.967092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:45.967204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.044253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:56:46.045398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.140495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 749/1495] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 06:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:56:46.145129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.146315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.157970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205098-685e-4d01-ae14-f362ad0d6f3d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:46.220280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:46.254720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:46.255320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:46.255593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:46.255858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.256496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:56:46.257324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:46.258355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:46.258355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 06:56:46.258355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 06:56:46.259235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:46.270307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 747/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 06:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:56:46.279285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.288963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912655-9ed5-4c15-8fcd-685f59ab0445 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:46.349769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:46.383808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:46.384415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:46.384728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:46.385002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.385638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:46.387368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:46.387368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 06:56:46.387368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 06:56:46.388613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:46.446738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 750/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 06:56:46 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:56:46.451217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.452750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.485424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a189d1-28ec-40a4-b143-5b3cd40807e1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:46.580967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:46.581571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:46.581844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:46.582108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.582737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:46.583780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:46.583780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 06:56:46.583780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 06:56:46.585602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:46.629399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 748/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 06:56:46 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:56:46.634259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.635789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.698358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efae62b-03e6-4ec8-b61c-c4cb99b49c4f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:46.783751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:46.795211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:46.795827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:46.796101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:46.796368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.797045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:46.798055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:46.798055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 06:56:46.798055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 06:56:46.798938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:46.812407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 751/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 06:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:56:46.816627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.818132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.830453 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f839a-7641-44cb-ab09-adada84d8349 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:46.855047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:46.925367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:46.925906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:46.926180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:46.926437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:46.927090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:46.928345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:46.928345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 06:56:46.928345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 06:56:46.929762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd3483-e9e9-4192-b35f-e588714a99ce admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:46.941597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 749/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 06:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:56:46.946928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:46.948518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:46.981937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc486d3-7acd-404f-9e63-24c2a97d86f6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:47.076332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:47.077020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.077319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.077587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] PATH_INFO: `/v3/projects/35a6e4da58b84b6a80b9b5378698fdb2/users/79fe6969e21d4f94b88a52da9119a718/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.099317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a6e4da58b84b6a80b9b5378698fdb2, user_id=79fe6969e21d4f94b88a52da9119a718, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:47.100336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:47.100336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 06:56:47.100336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 06:56:47.102300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382128ca-440a-4a94-929d-b4458b06e982 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:47.126038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 752/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 06:56:46 2022] PUT /identity/v3/projects/35a6e4da58b84b6a80b9b5378698fdb2/users/79fe6969e21d4f94b88a52da9119a718/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:56:47.138754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72441e-1b64-4457-9a1a-a66ae3634eb9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.139044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72441e-1b64-4457-9a1a-a66ae3634eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.139320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72441e-1b64-4457-9a1a-a66ae3634eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.197634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ae72441e-1b64-4457-9a1a-a66ae3634eb9 None None] MFA Rules not processed for user `79fe6969e21d4f94b88a52da9119a718`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:56:47.198789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ae72441e-1b64-4457-9a1a-a66ae3634eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:47.276051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 750/1502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 06:56:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:56:47.289805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434082ad-43cf-4149-9940-273b5181cadb None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.290091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434082ad-43cf-4149-9940-273b5181cadb None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.290368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434082ad-43cf-4149-9940-273b5181cadb None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.291683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 753/1503] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 13 06:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:56:47.296520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf7-b6a8-4207-89bf-ef8f3c534e19 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.296852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf7-b6a8-4207-89bf-ef8f3c534e19 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.297126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ebf7-b6a8-4207-89bf-ef8f3c534e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.329161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:47.375142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e597ebf7-b6a8-4207-89bf-ef8f3c534e19 None None] MFA Rules not processed for user `bc9bfa0fb8ee4875a6a9b24607e6a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:56:47.376336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e597ebf7-b6a8-4207-89bf-ef8f3c534e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:47.451583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 751/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 13 06:56:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:56:47.459294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434082ad-43cf-4149-9940-273b5181cadb None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:47.461406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-434082ad-43cf-4149-9940-273b5181cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:47.511698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:47.566607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434082ad-43cf-4149-9940-273b5181cadb None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:47.641041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:47.641646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.641920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.642190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.643790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:47.741218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:47.742627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:47.746013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:47.760242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 754/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:56:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:56:47.805916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b1d0-4bbe-4669-8e17-a1baca7fb38a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:47.806206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b1d0-4bbe-4669-8e17-a1baca7fb38a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:47.806475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71b1d0-4bbe-4669-8e17-a1baca7fb38a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:47.807724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 752/1506] 10.222.0.48 () {52 vars in 830 bytes} [Tue Sep 13 06:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:56:47.811402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:47.812631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:47.909183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf7ba1-e918-4a12-8da1-21d0741cd5a7 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:48.003375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:48.004020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:48.004188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:48.004459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] PATH_INFO: `/v3/users/79fe6969e21d4f94b88a52da9119a718` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:48.017583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fe6969e21d4f94b88a52da9119a718)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:48.018630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:48.018630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 06:56:48.018630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 06:56:48.019849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:48.029884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:48.089534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fe6969e21d4f94b88a52da9119a718'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:48.098797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fe6969e21d4f94b88a52da9119a718'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:48.099225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fe6969e21d4f94b88a52da9119a718'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:48.099768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fe6969e21d4f94b88a52da9119a718'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:48.114075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fe6969e21d4f94b88a52da9119a718'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:48.144638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 755/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 06:56:47 2022] DELETE /identity/v3/users/79fe6969e21d4f94b88a52da9119a718 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:56:48.149228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:48.149699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:48.149805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:48.205821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:56:48.207002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:48.281369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:48.294470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 753/1508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 06:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:56:48.304870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:48.306093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:48.403395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b4b9-a389-45ce-a01b-1c745113994f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:48.456876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:48.477793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:48.478394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:48.478667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:48.478932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:48.480540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:48.586371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:48.587738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206f79e-fdc4-4364-90e5-20d7421a7e01 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:48.606000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 756/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:56:48.947536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:56:48.948796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:56:48.961539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a01c-b916-48eb-adee-e2948fee2c81 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:56:49.057069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:56:49.057702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:56:49.057978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:56:49.058246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] PATH_INFO: `/v3/projects/35a6e4da58b84b6a80b9b5378698fdb2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:56:49.067930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a6e4da58b84b6a80b9b5378698fdb2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:56:49.069086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:56:49.069086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 06:56:49.069086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 06:56:49.070854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:56:49.129419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a6e4da58b84b6a80b9b5378698fdb2', 'request_id': 'req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:49.144299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a6e4da58b84b6a80b9b5378698fdb2', 'request_id': 'req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:49.155363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a6e4da58b84b6a80b9b5378698fdb2', 'request_id': 'req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:49.179568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] The token cache is being invalidate because project 35a6e4da58b84b6a80b9b5378698fdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:56:49.179854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:49.180370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e65860e6-dcd2-4c94-9f7e-5fdaec2c5524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:56:49.181709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 754/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 06:56:48 2022] DELETE /identity/v3/projects/35a6e4da58b84b6a80b9b5378698fdb2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:56:58.603798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=62 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:56:59.176911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:58:22.782946 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:22.783534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:22.783534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:22.784847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:22.790200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024d7-e2cd-46f7-8413-385e096a22d3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:22.790627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024d7-e2cd-46f7-8413-385e096a22d3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:22.790781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891024d7-e2cd-46f7-8413-385e096a22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:22.872118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-891024d7-e2cd-46f7-8413-385e096a22d3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:22.873345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-891024d7-e2cd-46f7-8413-385e096a22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:22.976927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:23.130809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:23.132963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:23.249007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdaa75-ff4f-4a74-bca4-fb4ba9918f2a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:23.254498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:23.255641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:23.255916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:23.256352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:23.264280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:23.265904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b4492-915e-4cc5-9304-33571f92b0d5 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:23.275246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 758/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:24.377965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324abf-d6f1-4855-8dab-25132413e892 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:24.378520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324abf-d6f1-4855-8dab-25132413e892 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:24.378520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f324abf-d6f1-4855-8dab-25132413e892 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:24.379854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:24.386792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdbda-ece9-4cae-a9e9-450d033616b4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:24.387248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdbda-ece9-4cae-a9e9-450d033616b4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:24.387361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdbda-ece9-4cae-a9e9-450d033616b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:24.406725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-da4fdbda-ece9-4cae-a9e9-450d033616b4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:24.407906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-da4fdbda-ece9-4cae-a9e9-450d033616b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:24.415634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:24.569978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f324abf-d6f1-4855-8dab-25132413e892 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:24.584598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f324abf-d6f1-4855-8dab-25132413e892 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:24.590060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:24.590646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:24.590920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:24.591191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:24.600241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:24.601866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826c6c9-d1b0-4db9-952a-ca8a830bc5b1 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:24.612264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 757/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:25.185253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c802f3-334b-44c9-9eda-4dbe2a0614a2 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:25.185554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c802f3-334b-44c9-9eda-4dbe2a0614a2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:25.185803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c802f3-334b-44c9-9eda-4dbe2a0614a2 None None] PATH_INFO: `/v3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:25.187061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 760/1517] 10.222.0.43 () {54 vars in 925 bytes} [Tue Sep 13 06:58:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:58:25.194111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272063b-ff39-4536-9c73-390795e15ecf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:25.194396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272063b-ff39-4536-9c73-390795e15ecf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:25.194694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272063b-ff39-4536-9c73-390795e15ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:25.252854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a272063b-ff39-4536-9c73-390795e15ecf None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:25.254037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a272063b-ff39-4536-9c73-390795e15ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:25.271582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:58:25.328682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 758/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 06:58:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:58:33.896836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c493bf-4234-46bc-bc68-00c121f5cb17 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:33.897304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c493bf-4234-46bc-bc68-00c121f5cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:33.897408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c493bf-4234-46bc-bc68-00c121f5cb17 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:33.898717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 761/1519] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 13 06:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:33.904157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a3f8-b375-4707-915a-0122b20b7d7f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:33.904640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a3f8-b375-4707-915a-0122b20b7d7f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:33.904752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a3f8-b375-4707-915a-0122b20b7d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:33.924736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e909a3f8-b375-4707-915a-0122b20b7d7f None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:33.925986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e909a3f8-b375-4707-915a-0122b20b7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:33.935643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 759/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 13 06:58:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:33.943888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c493bf-4234-46bc-bc68-00c121f5cb17 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:33.956922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c493bf-4234-46bc-bc68-00c121f5cb17 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:33.962474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:33.963062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:33.963339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:33.963605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:33.972237 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:33.974452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651010-43b4-462c-b3ef-e82a494aa00c service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:33.984293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 762/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:36.077927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ff22-baf6-4b2f-9445-ddb3b268b307 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:36.078463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ff22-baf6-4b2f-9445-ddb3b268b307 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:36.078463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98ff22-baf6-4b2f-9445-ddb3b268b307 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:36.079815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:36.086598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febac1e-d77a-4617-8c8b-5ac1a44a7c1f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:36.087044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febac1e-d77a-4617-8c8b-5ac1a44a7c1f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:36.087153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febac1e-d77a-4617-8c8b-5ac1a44a7c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:36.106904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9febac1e-d77a-4617-8c8b-5ac1a44a7c1f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:36.108086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9febac1e-d77a-4617-8c8b-5ac1a44a7c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:36.115776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:36.267967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ff22-baf6-4b2f-9445-ddb3b268b307 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:36.283639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98ff22-baf6-4b2f-9445-ddb3b268b307 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:36.289452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:36.290044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:36.290320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:36.290589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:36.298467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:36.300038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1dd9a-bfd4-4164-aebc-4304035a10e2 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:36.310561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 761/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:37.372534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ee80-b3c4-4e2d-8af4-01064d96108d None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:37.373082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ee80-b3c4-4e2d-8af4-01064d96108d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:37.373082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ee80-b3c4-4e2d-8af4-01064d96108d None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:37.374405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:37.380621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec437ac-6c6c-412b-a5c6-0bc0df72b1ac None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:37.381066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec437ac-6c6c-412b-a5c6-0bc0df72b1ac None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:37.381162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec437ac-6c6c-412b-a5c6-0bc0df72b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:37.400870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9ec437ac-6c6c-412b-a5c6-0bc0df72b1ac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:37.402086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9ec437ac-6c6c-412b-a5c6-0bc0df72b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:37.409967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:37.561574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ee80-b3c4-4e2d-8af4-01064d96108d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:37.576280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ee80-b3c4-4e2d-8af4-01064d96108d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:37.581656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:37.582240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:37.582519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:37.582790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:37.591284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:37.592868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f49c4d-6399-4a91-a42b-29a0504b4bd5 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:37.602338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 765/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:41.689873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:41.690326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:41.690426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:41.691731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:58:41.697048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f54c-aa05-4084-a802-0f3a4fd84f7b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:41.697483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f54c-aa05-4084-a802-0f3a4fd84f7b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:41.697590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f54c-aa05-4084-a802-0f3a4fd84f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:41.716985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0800f54c-aa05-4084-a802-0f3a4fd84f7b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:41.718171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0800f54c-aa05-4084-a802-0f3a4fd84f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:41.726777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:58:42.015260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:42.017001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:42.094868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9af61-e789-485b-be84-401fe6c12a3d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:42.098372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:42.098988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:42.099265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:42.099534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:42.108176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:42.109655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d45d-458a-44b6-b9f7-cceb17c7bebe service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:42.118749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 764/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:44.311478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ec81-c6de-4b5b-bc75-535c3e41973a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:44.312006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ec81-c6de-4b5b-bc75-535c3e41973a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:44.312006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ec81-c6de-4b5b-bc75-535c3e41973a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:44.313320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:44.319381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40bb8-ded3-40a1-ae34-fa11165a42a6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:44.319847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40bb8-ded3-40a1-ae34-fa11165a42a6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:44.319946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40bb8-ded3-40a1-ae34-fa11165a42a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:44.340002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0cc40bb8-ded3-40a1-ae34-fa11165a42a6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:44.341210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0cc40bb8-ded3-40a1-ae34-fa11165a42a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:44.349046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:44.648975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ec81-c6de-4b5b-bc75-535c3e41973a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:44.660024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ec81-c6de-4b5b-bc75-535c3e41973a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:44.664228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:44.664861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:44.665141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:44.665412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:44.674410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:44.675844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9255923-47e5-48b2-8a9b-3afbe7166a6b service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:44.686412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 768/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:48.588264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf588-5464-43f8-906c-102050896870 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:48.588891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf588-5464-43f8-906c-102050896870 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:48.588891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bf588-5464-43f8-906c-102050896870 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:48.590172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:48.595351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5aae1-b8ae-4b4a-ba28-3a046ad650cb None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:48.595802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5aae1-b8ae-4b4a-ba28-3a046ad650cb None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:48.595905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5aae1-b8ae-4b4a-ba28-3a046ad650cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:48.611637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=83 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:58:48.617884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-57e5aae1-b8ae-4b4a-ba28-3a046ad650cb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:48.619104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-57e5aae1-b8ae-4b4a-ba28-3a046ad650cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:48.626895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:48.940674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bf588-5464-43f8-906c-102050896870 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:48.942714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a68bf588-5464-43f8-906c-102050896870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:49.006380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:58:49.019667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bf588-5464-43f8-906c-102050896870 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:49.023899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:49.024504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:49.025234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:49.025234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:49.034053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:49.035472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93582a6d-f66e-4212-9180-7a47830f9b64 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:49.044694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 767/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:58:51.182327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:51.182883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:51.182883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:51.184199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:58:51.189505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947fc4-4c39-4fd7-a2d8-33090ebaa4aa None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:51.189928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947fc4-4c39-4fd7-a2d8-33090ebaa4aa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:51.190032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947fc4-4c39-4fd7-a2d8-33090ebaa4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:51.210589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f1947fc4-4c39-4fd7-a2d8-33090ebaa4aa None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:58:51.211765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f1947fc4-4c39-4fd7-a2d8-33090ebaa4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:51.219629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:58:51.523015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:58:51.524774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:58:51.538752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f8e16-4a9f-485a-943b-526b7f1ea15a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:58:51.542295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:58:51.542889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:58:51.543168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:58:51.543438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:58:51.552197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:58:51.553922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5940-ef7e-4d4b-a7c5-00ce697f92ab service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:58:51.563137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 771/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 06:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:59:01.205264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=11 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:59:01.559006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=6 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:17.376033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.377253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.377748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.410379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.412137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.420559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 769/1540] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.435499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.436544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.437205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.463699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.465303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.479245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 772/1541] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.485015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.498244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f60280-48d8-4759-95ae-d53012c0fc59 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:17.507244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:17.507884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.508164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.508436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.509152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:17.509458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:17.511316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c344-f6c8-4f2a-85c5-88ac8f3aa760 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:17.533363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 770/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:17.542313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.545849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e1d3-57bb-4c0a-abfe-eee5764c187b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.546173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e1d3-57bb-4c0a-abfe-eee5764c187b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.546404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66e1d3-57bb-4c0a-abfe-eee5764c187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.558487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79310161-7d1e-4cdd-bf4f-9503ad8c5daa None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:17.568204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:17.569294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.574944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.575581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.576480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:17.578861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4ffa-7300-4c8d-89d9-7ea944797ca0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:17.597572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7d66e1d3-57bb-4c0a-abfe-eee5764c187b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.599238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7d66e1d3-57bb-4c0a-abfe-eee5764c187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.614268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 771/1543] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 07:00:17.615887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.616389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.616893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.652686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 773/1544] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:17.652686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56cac-407a-49d6-8a7e-d2187d170d5f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.652686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56cac-407a-49d6-8a7e-d2187d170d5f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.652686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56cac-407a-49d6-8a7e-d2187d170d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.656521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.658147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.687295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c1e56cac-407a-49d6-8a7e-d2187d170d5f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.692600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c1e56cac-407a-49d6-8a7e-d2187d170d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.761260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 772/1545] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.762469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.778023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694f53-a6a9-4965-a9bb-949763e38192 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:17.791096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:17.791725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.792594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.792883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.793527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:17.795469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7ac3-3507-4c83-ae62-50e25ed4e454 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:17.799345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 774/1546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.801792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3806-54cb-42f4-9e0a-d742534164f0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.802078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3806-54cb-42f4-9e0a-d742534164f0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.802467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae3806-54cb-42f4-9e0a-d742534164f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.833667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a6ae3806-54cb-42f4-9e0a-d742534164f0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.834910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a6ae3806-54cb-42f4-9e0a-d742534164f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.839623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 773/1547] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:17.841065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.841355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.841632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.850631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 775/1548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.851968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8476bc2-9b10-4e29-8bbd-9f30fdc1e177 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.852255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8476bc2-9b10-4e29-8bbd-9f30fdc1e177 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.852528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8476bc2-9b10-4e29-8bbd-9f30fdc1e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.864422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.865754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.874148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e8476bc2-9b10-4e29-8bbd-9f30fdc1e177 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.875342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e8476bc2-9b10-4e29-8bbd-9f30fdc1e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.876862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.877677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.884952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 776/1550] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.886400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62a46-e02c-4d0a-bf9a-091a35a5953d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.886597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62a46-e02c-4d0a-bf9a-091a35a5953d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.886870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62a46-e02c-4d0a-bf9a-091a35a5953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.892222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9f00-4acd-4ef7-a7d5-d84a97f510fe None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:17.897525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:17.898124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.898402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.898675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.899447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:17.899753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:17.901427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:17.907423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-79f62a46-e02c-4d0a-bf9a-091a35a5953d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.909055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-79f62a46-e02c-4d0a-bf9a-091a35a5953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.918795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 775/1551] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:17.918795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.920989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 777/1552] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.922238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a6ac-0da2-4d0c-9f69-06787683468d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.922531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a6ac-0da2-4d0c-9f69-06787683468d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.922806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a6ac-0da2-4d0c-9f69-06787683468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.930353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd74c9-4d44-42bc-abb2-c25d27c272ce admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:17.935113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:17.935715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.935991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.936261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.936931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:17.938526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff35f1-6cf3-47c8-8fd8-e2fde2f36483 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:17.943002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2ae9a6ac-0da2-4d0c-9f69-06787683468d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.944215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2ae9a6ac-0da2-4d0c-9f69-06787683468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.950678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 776/1553] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:17.951949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.955733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 778/1554] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.955898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.955898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.956132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670081-5f9e-4a20-a030-32e146da8dd4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.956132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670081-5f9e-4a20-a030-32e146da8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.956132 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92670081-5f9e-4a20-a030-32e146da8dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:17.974088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-92670081-5f9e-4a20-a030-32e146da8dd4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.974507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:17.975296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-92670081-5f9e-4a20-a030-32e146da8dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.975662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:17.983239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 779/1555] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.990567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 777/1556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:17.990692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:17.990776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:17.990862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:17.990862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.004258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f58f0-0f1c-476f-bc90-3cdf7d4b15fc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.008835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.009171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:18.009450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.009726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.010018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.010383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:18.010670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.010966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.012752 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33434-8d19-49ac-9769-f484c812de89 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.018360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 780/1557] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:18.023984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.038146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 778/1558] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.038146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d919a-d049-45c1-aea5-341f42233094 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.038146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d919a-d049-45c1-aea5-341f42233094 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.038146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d919a-d049-45c1-aea5-341f42233094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.038574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceb99e-474b-4dd0-85b8-482fdb9f1b76 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.039748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.040345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.040649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.040924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.041545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.043596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.051812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-186d919a-d049-45c1-aea5-341f42233094 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:18.053055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-186d919a-d049-45c1-aea5-341f42233094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:18.061485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 779/1559] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:18.062371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d919a-d049-45c1-aea5-341f42233094 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.073562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d919a-d049-45c1-aea5-341f42233094 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.078668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 781/1560] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.078668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.134379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.134992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.135426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.135688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.136328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.137996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558ccf-5421-4c25-9c52-fa5a0e5decda admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.139220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.143039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4ad66-68fe-418a-b83c-3c5ede20bcc5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.148669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.149269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.149549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.149809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.150450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.150747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.151759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:18.151759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 07:00:18.151759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 07:00:18.152802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e612a5-8636-4824-a5f0-0fe411e96313 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.152929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 780/1561] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:18.153934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.154275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.154558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.155596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.173738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 782/1562] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.173738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.173738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.173738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.174474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:18.176036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:18.184207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 781/1563] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:18.185027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.192868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:18.194069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:18.195328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae9843-28cd-488b-afb3-02347284d3f5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.199860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.200449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.200758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.201034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.201674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.201962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 783/1564] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:18.202078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.202776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.203562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.212039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea957c-6d59-4128-bca7-82a49c2d4afe None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.222304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 782/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.222998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.223127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.223228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.223228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.223228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.223228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.223228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.229019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978eacce-0b14-4bf9-abf1-5bd419899c7f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.233570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.234161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.234437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.234709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.235340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.235647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.237280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.252714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 784/1566] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.252920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 783/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.253628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.253741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.263981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439695d-9708-48d4-b61d-d1fd5aac800d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.316417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09e2e-d56d-48e7-a00d-1bcfa1e0ea71 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.320948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.321206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.321609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.321794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.321895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.322067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.322165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] PATH_INFO: `/v3/projects/97cbfab657fc4dd79f80b94db1ccd01b/users/321f7ff9046d4efdbc54711780b033ac/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.322316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.322927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.323958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:18.323958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 07:00:18.323958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 07:00:18.325203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.337134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cbfab657fc4dd79f80b94db1ccd01b, user_id=321f7ff9046d4efdbc54711780b033ac, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.338456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:18.338456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 07:00:18.338456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 07:00:18.340737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.348854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 785/1568] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.349759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.356541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 784/1569] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:18 2022] PUT /identity/v3/projects/97cbfab657fc4dd79f80b94db1ccd01b/users/321f7ff9046d4efdbc54711780b033ac/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:18.357531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.359312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6736598-5ba7-4e4b-b719-51e414825ca9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.420141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ab4b5-c67f-4025-b04d-252023b92386 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.421663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.422278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.422556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.422828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.423460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.425366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.426268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.426380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.426547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.426815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.427454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.427753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.429610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.441173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 785/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.441917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.451660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee026c-2841-4bcd-999b-78e2e1861ee6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.457493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.458156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.458505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.458941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.459676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:18.460062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.461759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.465514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 786/1571] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.465514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.483051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 786/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:18.483051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.489311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5fdc7-30c6-4356-adeb-53b63f247610 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.507501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.514758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.526705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561a9d7-bc02-4229-90aa-e34861afa72f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.531247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.531848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.532125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.532392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.533043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.535014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.551182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.551936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.552285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.552555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.553388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.555848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.562657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 787/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.562657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.581745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 787/1574] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.581745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.589872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427169cf-cc21-4369-b1d2-3383535ba6b4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.630026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c8d0c-7cff-4ae4-b0ca-7f7fb842db39 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.635460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.636237 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.636515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.636836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.637470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.639365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.649403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.650016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.650295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.650568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.651217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.652865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e3901-b00e-4ea4-874f-a46dc9c52f5e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.663823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 788/1575] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:18.665081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.665368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.665638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.668146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 788/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.669294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.696289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] MFA Rules not processed for user `321f7ff9046d4efdbc54711780b033ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:18.697429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:18.732612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877037e3-13ec-4503-91a9-7bcc01438a77 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.737356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.738717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.739000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.739273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.740092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.741957 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.767926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 789/1577] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:18.767926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.769862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 789/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.770840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.777734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a6cbf-42c8-41f5-a755-0f1d098648bb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.820830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.826258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:18.839104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.839820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.840164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.840493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.841312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.843322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.848566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8c39-2f17-45c8-adb9-e43c7dfbc7c6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.853492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.854101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.854380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.854654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.855443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.857628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.865359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 790/1579] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.866049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.875543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e785-5cce-42d9-b9d7-b0324e022b8d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.881263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.881850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.882134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.882387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.883000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.884925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.890317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 790/1580] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.890317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.906436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 791/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:18.907251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.917401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d3f7-236e-4b0a-94c6-e8f690562a8b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.955582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef784219-230f-4753-b4d2-ff99cdad49ee admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.960199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.960897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.961171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.961437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.962071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.963654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.974078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 791/1582] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:18.974668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.977429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.978045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.978324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.978595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.979248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.980900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:18.984075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4895ce6-438d-4dfe-a90e-5aeb5a3b7b6b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:18.988813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:18.989414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:18.989689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:18.989955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:18.990566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:18.991603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 792/1583] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:18.991603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:18.994834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454356df-8498-46c4-add2-90de826f2106 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.002070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda6a-4454-4614-9d32-c56635f1c17d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.008436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.009065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.009343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.009675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.010232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.012128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.020748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 792/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:19.023905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03225-385a-48db-bc2b-224097cc3d77 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.023905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03225-385a-48db-bc2b-224097cc3d77 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.023905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03225-385a-48db-bc2b-224097cc3d77 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.023905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 793/1585] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 07:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:19.024611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03225-385a-48db-bc2b-224097cc3d77 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.037888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03225-385a-48db-bc2b-224097cc3d77 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.042418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.045938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 793/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:18 2022] POST /identity/v3/users => generated 291 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:19.046086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.046086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.046086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.046342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.046443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.046443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.053952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a301179-2147-4840-9bf6-6e779eb1232a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.057402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 794/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.058205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.061450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.062074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.062347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.062613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.063288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.065231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.068167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505387a0-1f88-4733-8010-404304777dfe admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.072688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.073271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.073547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.073818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.074448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.076013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.086744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 795/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.087549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.090475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 794/1589] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:19.091359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.097305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05088c6-0413-47e3-ada8-99215e97df84 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.101947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.102307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee89b34-c9d7-4a67-acb3-5f2b11bc4364 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.102642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.102923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.103193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.103944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.105497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.107299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.108312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.108675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.108981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] PATH_INFO: `/v3/projects/d38ccf6c6a10447b9ed7247ab19b4f85/users/c28a4cfa6f3d4d43b949931468ccb4ec/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.116612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 796/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.117480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.126936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9183f-bd3d-4c47-a8d6-ec7c92c8b6dd admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.127465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38ccf6c6a10447b9ed7247ab19b4f85, user_id=c28a4cfa6f3d4d43b949931468ccb4ec, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.131209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.132911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.133568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.133969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.134483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.135007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.136714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc78b4-1b68-45e7-b1db-f3204eb935b2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.148889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 797/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.150089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.150360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.150627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.152423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 795/1592] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/d38ccf6c6a10447b9ed7247ab19b4f85/users/c28a4cfa6f3d4d43b949931468ccb4ec/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.153333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.189709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.191542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:19.207127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.220909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996557eb-1638-4b39-9f0b-5fca957b00ca admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.226927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.227596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.227863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.228144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.228809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.230416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.234232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.242399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 796/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.243721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.255206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7ddd5-bc38-4c32-9150-6a5bc44541ca admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.259709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.260286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.260564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.260870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.261630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.263218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.263371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 798/1594] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:19.264204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.273992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b473-aed7-404b-b07e-1c6b7a17b2e2 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.274644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 797/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.275397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.278605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.279197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.279473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.279742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.280371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.281980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.285086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf7d0-80b9-4a1a-9b90-08f91f7d98ea admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.289654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.290227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.290499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.290768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.291394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.291770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 799/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.292538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.293429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.302198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2656a-a220-4fee-b1e1-ec90f5eb2cd7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.304678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 798/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.305530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.307090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.307838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.308115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.308379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] PATH_INFO: `/v3/projects/ff1d011b4b7d422088424bd1c08aa9de/users/9ad7b84391a74e08b0fc3ff0f8a2371c/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.315102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0b1f-7fc2-46eb-961c-d8e2f73df3bc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.320920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.321620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.322000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.322373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.323082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.324425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1d011b4b7d422088424bd1c08aa9de, user_id=9ad7b84391a74e08b0fc3ff0f8a2371c, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.324840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa986450-d8dc-4893-9909-d17f2bd7eda0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.327296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.335270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 799/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.336472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.336822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.337083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.343802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 800/1599] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/ff1d011b4b7d422088424bd1c08aa9de/users/9ad7b84391a74e08b0fc3ff0f8a2371c/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.344644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.367404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.368764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:19.405961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3abd5-6dcf-4409-a1f0-82918f3e3b3c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.411602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.412203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.412473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.412764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.413572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.415501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.426333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 801/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.427149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.430256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 800/1601] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:19.431610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.442143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104bcf9-d77e-4bf6-9b6f-452918c8b421 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.446765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.447417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.447696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.447965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] PATH_INFO: `/v3/projects/e6e55bb22dad4294bcaee9c1c5bf0625/users/7e3a230224be4212aa18fe752a07bde2/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.462820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e55bb22dad4294bcaee9c1c5bf0625, user_id=7e3a230224be4212aa18fe752a07bde2, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.465066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.478685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 801/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/e6e55bb22dad4294bcaee9c1c5bf0625/users/7e3a230224be4212aa18fe752a07bde2/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.479570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.505523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69560d-945f-4d7d-aa8d-0330e4939442 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.538100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.546367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e02c97-7d47-4c58-937d-5ce2e21b97ee admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.552450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.553241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.553862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.554195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] PATH_INFO: `/v3/projects/91a66973ccb646f4b92203c9a3f910ac/users/44aaf56f8bde416fab0bff2989d9c1a2/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.570905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a66973ccb646f4b92203c9a3f910ac, user_id=44aaf56f8bde416fab0bff2989d9c1a2, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.571718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.572321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.572623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.572897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.573720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.590895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 802/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/91a66973ccb646f4b92203c9a3f910ac/users/44aaf56f8bde416fab0bff2989d9c1a2/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.590895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.604037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.633255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.637423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.649488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 802/1604] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:19.650574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.661686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dcf38-2b79-40b5-b102-d4e17dd5e797 service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.664402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3f9a-4ef3-4f7a-814b-4003cdf5a0b9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.667306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.668337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.668876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.669130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.669481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] PATH_INFO: `/v3/projects/1235a75d676c4817b992c320a22231a8/users/a550f2f8fd1a4d98adb3817e8a284ba3/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.669740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.670019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.670292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.670935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.672561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a617f-5b8e-4813-ad54-1414415ba871 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.684654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 803/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:19.689056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.689419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.689767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.690183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1235a75d676c4817b992c320a22231a8, user_id=a550f2f8fd1a4d98adb3817e8a284ba3, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.693641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.709395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 803/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/1235a75d676c4817b992c320a22231a8/users/a550f2f8fd1a4d98adb3817e8a284ba3/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.709985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.729756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] MFA Rules not processed for user `9ad7b84391a74e08b0fc3ff0f8a2371c`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.730904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:19.774565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c149b1-0a65-4f58-94c6-fa61b6b1ee3a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.779361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.780017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.780299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.780569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] PATH_INFO: `/v3/projects/1d11e9f1451444cc8b7ceb250b544ed8/users/d88c0a666afb485a8aa4066793877b8b/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.797267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d11e9f1451444cc8b7ceb250b544ed8, user_id=d88c0a666afb485a8aa4066793877b8b, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.800231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4c9b-b4d9-485d-8a6c-3d013097eadc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.812496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 804/1607] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:19.813429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.815115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 804/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/1d11e9f1451444cc8b7ceb250b544ed8/users/d88c0a666afb485a8aa4066793877b8b/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.816193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1f20-31d6-4584-ab26-bdea900dd255 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.816512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1f20-31d6-4584-ab26-bdea900dd255 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.816818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1f20-31d6-4584-ab26-bdea900dd255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.840443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-02ac1f20-31d6-4584-ab26-bdea900dd255 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.841706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-02ac1f20-31d6-4584-ab26-bdea900dd255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:19.869903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.886079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc451b31-ab1c-406a-9741-8600d8733c23 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.907335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 805/1609] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:19.908808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.909284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.909710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.930571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.932203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:19.939637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.940209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 806/1610] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:19.940335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.940690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.941019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.941124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.950850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.951030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddb8fd-398d-4f2e-b273-6f9d6338c4b8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:19.952292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00942e10-76f9-4943-93c8-a6ab0dd5c480 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.955371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:19.956019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.956019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.957081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:19.957176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] PATH_INFO: `/v3/projects/8573b9b8cea74fc787116a99b12f81e0/users/0ee62cef279e4a95bd9661306c319b52/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.963937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 805/1611] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:19.965366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfe1b-5f33-46a0-a3c2-313b086fffee None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:19.965504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfe1b-5f33-46a0-a3c2-313b086fffee None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:19.965719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfe1b-5f33-46a0-a3c2-313b086fffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:19.972642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8573b9b8cea74fc787116a99b12f81e0, user_id=0ee62cef279e4a95bd9661306c319b52, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:19.975307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:19.990735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 807/1612] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:19 2022] PUT /identity/v3/projects/8573b9b8cea74fc787116a99b12f81e0/users/0ee62cef279e4a95bd9661306c319b52/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:19.993514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:19.997664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-75fcfe1b-5f33-46a0-a3c2-313b086fffee None None] MFA Rules not processed for user `a550f2f8fd1a4d98adb3817e8a284ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:19.998906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-75fcfe1b-5f33-46a0-a3c2-313b086fffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:20.068072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6002f2-a393-448c-9490-55f6ac21d1d8 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.073101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.073708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.074164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.074507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.075319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.077540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfa90-fa8a-4b5f-8589-391cb200296e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.085448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 806/1613] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:20.086704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.086998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.087239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.112183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 808/1614] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:19 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:20.117228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716c4-b954-422b-8110-47ca63c27b97 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.117589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716c4-b954-422b-8110-47ca63c27b97 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.117935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd716c4-b954-422b-8110-47ca63c27b97 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.119431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 809/1615] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 07:00:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:20.120116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd716c4-b954-422b-8110-47ca63c27b97 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.125299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] MFA Rules not processed for user `d88c0a666afb485a8aa4066793877b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:20.127185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:20.196749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd716c4-b954-422b-8110-47ca63c27b97 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.200997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.201705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.201971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.202370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.211539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 807/1616] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:20.212390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.223678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc0e94-4041-462f-a0be-d608a3bc65bd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.229726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.230331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.230607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.230874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.256824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:20.292302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.293837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19c3e-2f92-44ec-b4b6-48d8d0699aa7 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.304890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 810/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:20.306147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.306429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.306697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.310368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.312569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.325546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 808/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:20.326712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.342723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:20.354171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:20.355604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:20.366532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 811/1619] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:20.367625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.381671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c56f-531f-4dba-b92d-1e9802027f86 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.387392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.389116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.389508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.389995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.390710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.392881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20723-4e67-4fa6-a589-2fda6e20d684 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.431540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175d891-c458-4ac2-99e3-98c21d9bac13 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.436239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.436401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 812/1620] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/users => generated 292 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:20.436774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.437057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.437382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.438222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.438552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.438829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.480695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:20.484054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:20.537445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.540351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.557434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 809/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:20.558499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.571730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fac07-a95c-4343-ae37-69b1b0efd8ce service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.578323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.579563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.579563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.579815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.580408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.582193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:20.582193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 07:00:20.582193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 07:00:20.583583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.587503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 813/1622] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:20.594803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.607300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629a610-17c0-4f3c-903a-2375291d702a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.613251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.614424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.614865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.615352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.627315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 810/1623] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:20.629028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.629296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.631011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.643178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 814/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:20.645479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.654777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222a0f-4c74-40bd-8497-c7f30bf8cda3 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.716826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.717781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.718322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.719086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.726707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75914200-8f13-4807-bdde-41d32ef42bf2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.738101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.740263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.740696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.741227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.744753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.746518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.780700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 811/1625] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:20.783407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.806559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711c1a-0e92-4a71-9e84-b5be8ee33c08 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.812953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a589-add6-48b7-880e-358026646618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.813577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a589-add6-48b7-880e-358026646618 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.814325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a589-add6-48b7-880e-358026646618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.820039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a589-add6-48b7-880e-358026646618 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.820839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a589-add6-48b7-880e-358026646618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.825269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a589-add6-48b7-880e-358026646618 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.835706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:20.878286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 812/1626] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:20 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:20.880046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a589-add6-48b7-880e-358026646618 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.895101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.898731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:20.904548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a589-add6-48b7-880e-358026646618 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.916465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.918311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.919524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.919524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] PATH_INFO: `/v3/projects/bf3b2b15250a445987a26189bf662e0d/users/3f28ae7009f34fe39f6199dc90bfaadd/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.925215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 815/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:20.942493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:20.978718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588bf25-a9d4-4546-8017-57a03fd1129a service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:20.988628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b2b15250a445987a26189bf662e0d, user_id=3f28ae7009f34fe39f6199dc90bfaadd, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:20.997250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:20.997878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:20.998159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:20.998434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:20.999656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.002457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.009372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.031717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:21.058016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 813/1628] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:20 2022] PUT /identity/v3/projects/bf3b2b15250a445987a26189bf662e0d/users/3f28ae7009f34fe39f6199dc90bfaadd/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:21.062365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 816/1629] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:21.063316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.064690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.090933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d62b36-ffa1-477c-adeb-78db370be566 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:21.249127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:21.249971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.250263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.250548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] PATH_INFO: `/v3/projects/4769722d27db4902ac10e0b86702265c/users/5ccc04128f15452b8fd214fcbbaddfc7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.273912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4769722d27db4902ac10e0b86702265c, user_id=5ccc04128f15452b8fd214fcbbaddfc7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.277730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.300160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 817/1630] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:21 2022] PUT /identity/v3/projects/4769722d27db4902ac10e0b86702265c/users/5ccc04128f15452b8fd214fcbbaddfc7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:21.302758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.307950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b776ac0-013b-489a-b869-0a6f48d869bf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:21.400022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e576e96-ea45-45be-829b-34748d730afc admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:21.407710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:21.408880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.409528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.410543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.411333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.413914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.434424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 818/1631] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:21.439608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.458211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:21.466075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.466075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.466075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.466075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.466075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.474683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7a26b-20ef-47c1-bb76-8d7e3f69d191 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:21.491339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:21.495641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 814/1632] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:21.496245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.496245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.496245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] PATH_INFO: `/v3/projects/4769722d27db4902ac10e0b86702265c/users/5ccc04128f15452b8fd214fcbbaddfc7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.497341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.504566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4769722d27db4902ac10e0b86702265c, user_id=5ccc04128f15452b8fd214fcbbaddfc7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.516484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab095e-7aef-4a24-9d48-cb149f092433 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.523803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbba1b-3562-4752-8e4f-d3891a106a64 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:21.542681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:21.543899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.544426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.544836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] PATH_INFO: `/v3/projects/bf3b2b15250a445987a26189bf662e0d/users/3f28ae7009f34fe39f6199dc90bfaadd/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.552618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b2b15250a445987a26189bf662e0d, user_id=3f28ae7009f34fe39f6199dc90bfaadd, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:21.557735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 819/1633] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:21 2022] PUT /identity/v3/projects/4769722d27db4902ac10e0b86702265c/users/5ccc04128f15452b8fd214fcbbaddfc7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:21.570541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9b7c-c7f2-4fba-a0d3-3bcf1459964a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:21.570776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.571060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.571439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.606100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 815/1634] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:21 2022] PUT /identity/v3/projects/bf3b2b15250a445987a26189bf662e0d/users/3f28ae7009f34fe39f6199dc90bfaadd/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:00:21.614426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:21.614762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:21.615040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:21.686198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] MFA Rules not processed for user `3f28ae7009f34fe39f6199dc90bfaadd`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:21.687691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:21.696752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] MFA Rules not processed for user `5ccc04128f15452b8fd214fcbbaddfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:21.698039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:21.750537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:21.893941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 816/1635] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:21.907368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:21.929638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 820/1636] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:21.953701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:22.072525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf216-5d25-48a1-b7b0-5e8a10302615 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:22.077735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:22.078641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:22.079032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:22.079569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:22.101175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:22.102948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:22.142839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 817/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:22.154880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:22.169941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19abe6-ab38-49f2-af0a-360c17b8001c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:22.181312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:22.182246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:22.182672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:22.183052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:22.221735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:22.223326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d4f77-6dba-42a2-ae4a-588774397ddc service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:22.245282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 821/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:22.420368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:22.442012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af9eb-f41c-45e8-a0ff-bd06fc6d0857 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:22.466805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:22.468222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:22.472735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:22.473466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:22.633154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:22.635621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac43c2-0b05-44b4-a260-88dcc5b7c7d8 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:22.652530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 818/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:23.137191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f495b-6f03-429f-8e2c-41cb4a948fda None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.137756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f495b-6f03-429f-8e2c-41cb4a948fda None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.138036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f495b-6f03-429f-8e2c-41cb4a948fda None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.140726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 822/1640] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 07:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:23.159557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ce4a-4955-49d5-9315-167ec63bfce4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.159557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ce4a-4955-49d5-9315-167ec63bfce4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.159557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ce4a-4955-49d5-9315-167ec63bfce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.209415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1387ce4a-4955-49d5-9315-167ec63bfce4 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:23.210725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1387ce4a-4955-49d5-9315-167ec63bfce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:23.419401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 819/1641] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 07:00:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:23.428111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ff8-3176-4b6c-81b4-adf447fe68e0 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.428739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ff8-3176-4b6c-81b4-adf447fe68e0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.428955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ff8-3176-4b6c-81b4-adf447fe68e0 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.431460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 823/1642] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 07:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:23.439394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.439749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.439985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.494442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:23.495689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:23.524269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 820/1643] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:00:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:23.565485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68ff8-3176-4b6c-81b4-adf447fe68e0 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:23.575614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:23.603223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bc223-4d9d-47c9-8bf0-76412f984231 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:23.618425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:23.619068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.619344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.619613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.645848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:23.647648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7983e3-a501-4f68-8724-1eb7c46b692a service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:23.683865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 821/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:23.776059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68ff8-3176-4b6c-81b4-adf447fe68e0 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:23.816596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:23.817265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:23.817546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:23.817867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] PATH_INFO: `/v3/users/9ad7b84391a74e08b0fc3ff0f8a2371c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:23.819413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad7b84391a74e08b0fc3ff0f8a2371c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:23.821369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:23.908271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad7b84391a74e08b0fc3ff0f8a2371c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:23.930522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad7b84391a74e08b0fc3ff0f8a2371c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:23.931212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad7b84391a74e08b0fc3ff0f8a2371c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:23.932172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad7b84391a74e08b0fc3ff0f8a2371c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:23.950466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad7b84391a74e08b0fc3ff0f8a2371c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:24.008405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 824/1645] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:23 2022] DELETE /identity/v3/users/9ad7b84391a74e08b0fc3ff0f8a2371c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:24.012889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:24.013609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:24.013749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:24.058056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:24.059277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:24.085671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:24.163763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 822/1646] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:24.201764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:24.208133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:24.278580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:24.351018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c36e1-5c41-4a93-a8d8-08d318df90c9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:24.364649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:24.365507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:24.366223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:24.366600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:24.379991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:24.382168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:24.397177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 825/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:25.577166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:25.579093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:25.615831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b7701-c57e-405b-95ff-72c1d76ea221 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:25.645697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:25.647838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:25.648271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:25.648741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] PATH_INFO: `/v3/projects/ff1d011b4b7d422088424bd1c08aa9de` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:25.651672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1d011b4b7d422088424bd1c08aa9de)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:25.654106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:25.728285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1d011b4b7d422088424bd1c08aa9de', 'request_id': 'req-544eae8d-fe90-4c60-a482-ff8f0d9f6711'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:25.741911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1d011b4b7d422088424bd1c08aa9de', 'request_id': 'req-544eae8d-fe90-4c60-a482-ff8f0d9f6711'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:25.755626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1d011b4b7d422088424bd1c08aa9de', 'request_id': 'req-544eae8d-fe90-4c60-a482-ff8f0d9f6711'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:25.773181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] The token cache is being invalidate because project ff1d011b4b7d422088424bd1c08aa9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:25.773615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:25.774298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:25.775924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 823/1648] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:25 2022] DELETE /identity/v3/projects/ff1d011b4b7d422088424bd1c08aa9de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:25.780121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:25.795778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0af6-365d-4f2c-b077-f293d8585ef2 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:25.948182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:25.948865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:25.949354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:25.949727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] PATH_INFO: `/v3/users/3f28ae7009f34fe39f6199dc90bfaadd` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:25.952166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f28ae7009f34fe39f6199dc90bfaadd)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:25.954163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:26.086859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f28ae7009f34fe39f6199dc90bfaadd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:26.099414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f28ae7009f34fe39f6199dc90bfaadd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:26.100752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f28ae7009f34fe39f6199dc90bfaadd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:26.101864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f28ae7009f34fe39f6199dc90bfaadd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:26.117703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f820b231-b9c0-4ebc-8762-2bb713bdde8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f28ae7009f34fe39f6199dc90bfaadd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:26.159514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 826/1649] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:25 2022] DELETE /identity/v3/users/3f28ae7009f34fe39f6199dc90bfaadd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:26.956527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:26.960420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:27.001070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eae8d-fe90-4c60-a482-ff8f0d9f6711 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:27.283649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:27.286796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:27.287266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:27.289386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] PATH_INFO: `/v3/projects/bf3b2b15250a445987a26189bf662e0d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:27.297361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3b2b15250a445987a26189bf662e0d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:27.304980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:27.439432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3b2b15250a445987a26189bf662e0d', 'request_id': 'req-1342435b-8709-4da0-87ac-8e7c1e82c5ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:27.447515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:27.461762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3b2b15250a445987a26189bf662e0d', 'request_id': 'req-1342435b-8709-4da0-87ac-8e7c1e82c5ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:27.500890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3b2b15250a445987a26189bf662e0d', 'request_id': 'req-1342435b-8709-4da0-87ac-8e7c1e82c5ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:27.536424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] The token cache is being invalidate because project bf3b2b15250a445987a26189bf662e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:27.538001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:27.540780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1342435b-8709-4da0-87ac-8e7c1e82c5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:27.543868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 824/1650] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:26 2022] DELETE /identity/v3/projects/bf3b2b15250a445987a26189bf662e0d => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:27.549363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:27.550521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:27.550947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:27.637167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:27.638426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:27.751931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:27.814297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 827/1651] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:27.825581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:27.825776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:27.826074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:27.908996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:27.919622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:27.955581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 825/1652] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:27.956843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:27.974630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89af41-24f7-4d54-ae5c-3a8f9053137f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:27.999458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.000255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.000721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.020831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.026617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:28.027062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.031853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.072405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 828/1653] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:00:28.076645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.087726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4341-1c13-4262-b191-87dd0444fd75 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:28.110723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.111381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.116398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.116708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.117414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.119560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.192239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 826/1654] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:28 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:28.192756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.231689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002289d-3409-4556-89f1-9df99fa42ec1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:28.458944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.458944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.458944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.458944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.459406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.459406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.544930 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 829/1655] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:28 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:28.550582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.597120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14349313-d954-403c-b90c-602dae9efd14 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:28.617788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.621764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.636365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.637178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.639242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.648035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.664109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 827/1656] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:28.664915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.679492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37d41-46ce-43ae-9cd6-6f03fe10a26b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:28.705345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.706593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.706881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.707161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.707844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.709524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.755757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 830/1657] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:00:28.758823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.778300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7235cd-91eb-4185-8fae-3b4fdeee2a78 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:28.808604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:28.811051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.811455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.812336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] PATH_INFO: `/v3/projects/f72d1cd6d9264b5f8f5931606bf6a9fd/users/0353fe8d713a431d84f3535d935db75b/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.895634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72d1cd6d9264b5f8f5931606bf6a9fd, user_id=0353fe8d713a431d84f3535d935db75b, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:28.912721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae92d25-61d7-4f99-a2f0-751c792da00c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:28.934848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:28.937173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:28.959704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 828/1658] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:28 2022] PUT /identity/v3/projects/f72d1cd6d9264b5f8f5931606bf6a9fd/users/0353fe8d713a431d84f3535d935db75b/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:28.969963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956d6-1055-4918-898f-961030e3b236 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:28.970518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956d6-1055-4918-898f-961030e3b236 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:28.971721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f956d6-1055-4918-898f-961030e3b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:28.972018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b352b1-516d-4fd9-8282-06a67fe5239c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:29.090422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-03f956d6-1055-4918-898f-961030e3b236 None None] MFA Rules not processed for user `0353fe8d713a431d84f3535d935db75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:29.092433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-03f956d6-1055-4918-898f-961030e3b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:29.187252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:29.187891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:29.188176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:29.188451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] PATH_INFO: `/v3/users/321f7ff9046d4efdbc54711780b033ac` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:29.193324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=321f7ff9046d4efdbc54711780b033ac)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:29.195298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:29.342328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 829/1659] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:29.348710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f956d6-1055-4918-898f-961030e3b236 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:29.382764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f956d6-1055-4918-898f-961030e3b236 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:29.391463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321f7ff9046d4efdbc54711780b033ac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:29.397052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:29.403895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:29.404561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:29.404895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:29.405333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:29.406254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:29.408591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:29.422729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321f7ff9046d4efdbc54711780b033ac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:29.425080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321f7ff9046d4efdbc54711780b033ac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:29.442401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321f7ff9046d4efdbc54711780b033ac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:29.459278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3c6a54ce-329b-41f8-af6c-7f2080f57fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321f7ff9046d4efdbc54711780b033ac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:29.470525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 830/1660] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:29 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:29.474391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:29.480862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:29.532192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 831/1661] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:28 2022] DELETE /identity/v3/users/321f7ff9046d4efdbc54711780b033ac => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:29.543067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:29.543465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:29.543661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:29.616292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:29.618120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:29.660064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:29.703541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49031143-b545-4f4f-af32-783ca1bd0648 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:29.778286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 832/1662] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:29.815725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:29.818928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:29.905364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:29.906291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:29.906716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:29.907110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:29.907906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:29.916316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:29.947033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c346d12-6c41-4e42-b1c5-90b134e0623f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:29.954752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:29.957667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:29.958025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:29.958937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:29.977286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:29.979065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:29.995511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 831/1663] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:29 2022] POST /identity/v3/users => generated 291 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:00:30.004651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 833/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:30.005352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:30.028061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d785-047a-425b-8d54-36eae2d037d9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:30.041634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:30.043195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.043617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.044038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.045366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:30.047751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:30.074734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 832/1665] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:30.081380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:30.102810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7470e-3bb9-48f6-ada0-fe64814ee0d8 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:30.115713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:30.116698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.117131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.117583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] PATH_INFO: `/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.151017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1e7f83c8cc4225bb82cb193794bc9a, user_id=f8e62ea21d4d4bcdbd6a584bf1c6bde2, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:30.155382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:30.194857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 834/1666] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:30 2022] PUT /identity/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:30.199084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:30.216879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca425f-b559-4d22-a9b0-489fa4c8b1fe admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:30.346928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:30.347645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.347925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.348195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.348964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:30.351877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4871f61-dd03-4799-aa8b-ab2179cbdd98 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:30.364078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 833/1667] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:30.368112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:30.385538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6faed8-28c0-4a4b-b2dc-8640cbaba29e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:30.398469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:30.399296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.399724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.400009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] PATH_INFO: `/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.405687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1e7f83c8cc4225bb82cb193794bc9a, user_id=f8e62ea21d4d4bcdbd6a584bf1c6bde2, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:30.410599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:30.450236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 835/1668] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:30 2022] PUT /identity/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:30.455917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.456343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.456644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.496644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] MFA Rules not processed for user `f8e62ea21d4d4bcdbd6a584bf1c6bde2`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:30.498020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:30.586295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:30.623770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 834/1669] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:30.632183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:30.634467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:30.729011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:30.839558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4429cae-0561-46ff-9e9d-e6d90f71ad8b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:30.860730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:30.863494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:30.863857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:30.864133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:30.889705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:30.891182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30b035-d014-48d5-b094-dbac95a4358b service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:30.926778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 836/1670] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:32.431356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:32.431356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:32.618425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc41ad-22eb-43da-a6d4-1ebea89e7f76 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:32.636897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:32.637561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:32.637837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:32.638109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] PATH_INFO: `/v3/projects/97cbfab657fc4dd79f80b94db1ccd01b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:32.640300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cbfab657fc4dd79f80b94db1ccd01b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:32.642256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:32.771710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cbfab657fc4dd79f80b94db1ccd01b', 'request_id': 'req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:32.782884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cbfab657fc4dd79f80b94db1ccd01b', 'request_id': 'req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:32.799995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cbfab657fc4dd79f80b94db1ccd01b', 'request_id': 'req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:32.843590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] The token cache is being invalidate because project 97cbfab657fc4dd79f80b94db1ccd01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:32.846668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:32.847748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:32.856794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30403-a18d-4bdd-aae9-d81233275b99 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:32.857954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30403-a18d-4bdd-aae9-d81233275b99 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:32.858905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30403-a18d-4bdd-aae9-d81233275b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:32.860685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 835/1671] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:32 2022] DELETE /identity/v3/projects/97cbfab657fc4dd79f80b94db1ccd01b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:32.910340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-36d30403-a18d-4bdd-aae9-d81233275b99 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:32.911592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-36d30403-a18d-4bdd-aae9-d81233275b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.035966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:33.038031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.142490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 837/1672] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:00:33.144805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:33.145099 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:33.148039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:33.205174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098d077-6c9c-4a43-8c7a-6c9a6dc71366 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:33.225315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:33.225757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:33.226327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:33.226699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:33.227021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.227134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] PATH_INFO: `/v3/users/a550f2f8fd1a4d98adb3817e8a284ba3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:33.242602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a550f2f8fd1a4d98adb3817e8a284ba3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:33.244222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:33.244222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: warnings.warn(msg) Sep 13 07:00:33.244222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: Sep 13 07:00:33.247316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:33.271047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 838/1673] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:33.272120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:33.275734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.310712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e7c84-3bb8-4e96-a347-9393842ebc24 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:33.318326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:33.319287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:33.319757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:33.320310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] PATH_INFO: `/v3/users/d88c0a666afb485a8aa4066793877b8b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:33.322068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88c0a666afb485a8aa4066793877b8b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:33.326975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:33.389803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:33.463806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88c0a666afb485a8aa4066793877b8b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.477059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a550f2f8fd1a4d98adb3817e8a284ba3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.490302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88c0a666afb485a8aa4066793877b8b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.492224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88c0a666afb485a8aa4066793877b8b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.493203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88c0a666afb485a8aa4066793877b8b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.499526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a550f2f8fd1a4d98adb3817e8a284ba3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.503382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a550f2f8fd1a4d98adb3817e8a284ba3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.505065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a550f2f8fd1a4d98adb3817e8a284ba3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.518706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88c0a666afb485a8aa4066793877b8b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.575891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a2bd9cfd-3851-4986-a755-0ff32ce41a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a550f2f8fd1a4d98adb3817e8a284ba3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:33.600146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 839/1674] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:33 2022] DELETE /identity/v3/users/d88c0a666afb485a8aa4066793877b8b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:33.607411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:33.619106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.685400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 836/1675] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:33 2022] DELETE /identity/v3/users/a550f2f8fd1a4d98adb3817e8a284ba3 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:33.690769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a74b-2dbf-4140-b086-74fffe51568c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:33.690769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a74b-2dbf-4140-b086-74fffe51568c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:33.700724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01a74b-2dbf-4140-b086-74fffe51568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:33.788963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3b01a74b-2dbf-4140-b086-74fffe51568c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:33.794175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b01a74b-2dbf-4140-b086-74fffe51568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:33.811522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:33.885049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d9fd6-be26-4b50-93fa-fd355bb7cc0e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:33.963035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 837/1676] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:33.964337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:33.964668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:33.964945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.022758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:34.024188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.051012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 838/1677] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:34.068225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.068956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.069258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.069679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.070389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:34.070703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.072413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.095867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.100023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.102396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 840/1678] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:34.106713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.108620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.137150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42637-6c17-4a11-898a-51cc74c4ca37 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.144643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.148420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.148976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.149814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.150595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.157824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.217433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 841/1679] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:34 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:00:34.219889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.223702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.253384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dc239-ddd3-469d-a956-6e235c77a674 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.356011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598cf08-b1cd-4275-8701-c58af209075c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.370289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.371138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.371452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.371728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.372339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.373004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.375432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.375734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] PATH_INFO: `/v3/users/0353fe8d713a431d84f3535d935db75b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.382513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0353fe8d713a431d84f3535d935db75b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.385445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.386188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:34.394712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.398792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.418955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 839/1680] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:00:34.419733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.447875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e96d-3550-428e-8d11-a635444e9adf service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.455212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.455883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.457926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.458221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.499542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.503526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.513311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0353fe8d713a431d84f3535d935db75b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:34.525273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 840/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:34.526782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.533211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0353fe8d713a431d84f3535d935db75b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:34.534497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0353fe8d713a431d84f3535d935db75b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:34.535497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0353fe8d713a431d84f3535d935db75b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:34.543660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:34.547158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cea5450-c08d-4dea-96fa-2c2fcef64486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0353fe8d713a431d84f3535d935db75b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:34.557041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b11-f8e1-4225-9919-4395b051a0bf service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.573344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.574438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.574438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.574643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.575202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.580463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dfda2-eb0f-45c6-b3b9-1f8b6291089b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.604102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 842/1682] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:34 2022] DELETE /identity/v3/users/0353fe8d713a431d84f3535d935db75b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:34.609368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ffc38-d658-447d-b345-5ebfc32fd0ef None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.609703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ffc38-d658-447d-b345-5ebfc32fd0ef None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.609980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ffc38-d658-447d-b345-5ebfc32fd0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.642842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 841/1683] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:34 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:34.644305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.644786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.644886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.680025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-108ffc38-d658-447d-b345-5ebfc32fd0ef None None] MFA Rules not processed for user `c28a4cfa6f3d4d43b949931468ccb4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:34.681313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-108ffc38-d658-447d-b345-5ebfc32fd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.692535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:34.693818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.840533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 842/1684] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:34.841493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.847934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.872718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 843/1685] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:34.881815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0bc7f-8463-4fa1-9a48-155f319ecbc0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.885523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.886456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.887338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.889746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.890407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.890708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:34.894536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:34.895425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:34.897268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:34.935974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] MFA Rules not processed for user `c28a4cfa6f3d4d43b949931468ccb4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:34.939233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.953823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 843/1686] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:34.954992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.960654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 844/1687] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:34.967660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:34.972761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:34.986916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ff42a-a2ad-4204-9a1c-de53feb25dd9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:34.998296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:34.999277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:34.999760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.000233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.001260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:35.003307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:35.022052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 845/1688] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:35.023538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:35.031218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:35.159710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241319-4599-4862-b07a-7660fecd5f34 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:35.168155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:35.169036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:35.169314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.171983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.213232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:35.217461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:35.262869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 844/1689] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:35.263805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:35.300181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05376f-ea11-485f-b661-fb3fef3f35db admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:35.314090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9885-4fb2-4671-8738-2a35d269ae36 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:35.334443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:35.335863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:35.338188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:35.338877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:35.339151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.339418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] PATH_INFO: `/v3/projects/d0ce4a3c27e34fac8c98d048263bc5c2/users/bf8c2c3ac77b41a5b08ae9155f677c7f/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.339781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.340076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.370829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:35.374630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943115f-a099-4052-be98-9566e88de8a5 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:35.408620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ce4a3c27e34fac8c98d048263bc5c2, user_id=bf8c2c3ac77b41a5b08ae9155f677c7f, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:35.411934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:35.423403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 846/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:35.460240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 845/1691] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:35 2022] PUT /identity/v3/projects/d0ce4a3c27e34fac8c98d048263bc5c2/users/bf8c2c3ac77b41a5b08ae9155f677c7f/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:35.473274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:35.473559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.473793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.558756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] MFA Rules not processed for user `bf8c2c3ac77b41a5b08ae9155f677c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:35.559993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:35.649053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:35.755652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 847/1692] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:35.756719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:35.838263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:35.908250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376b74-ccbf-40cc-81c3-1d2fd363c87c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:35.920571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:35.921231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:35.921517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:35.921792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:35.922436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:35.924769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:35.992933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 846/1693] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:35 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:00:35.997338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:36.042009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f2cfe-227c-4956-8b4b-5719a46818a7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:36.154804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:36.158214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.159858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.160650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.161657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:36.165450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:36.223762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 848/1694] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:35 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:36.224400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:36.240668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745670fd-39c3-4e35-ac3e-a0c3629ba130 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:36.256414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:36.257473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.257993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.258477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.259358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:36.261281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:36.279714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 847/1695] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:36.287168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:36.308271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497208b-98f7-4c46-a428-9d5651f46f5f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:36.323785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:36.324553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.327133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.327503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] PATH_INFO: `/v3/projects/7d8972923e014f219646c695fe706676/users/eb524d7cc7674ce2ade08297c0a2b874/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.400435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8972923e014f219646c695fe706676, user_id=eb524d7cc7674ce2ade08297c0a2b874, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:36.403638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:36.447887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 849/1696] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:36 2022] PUT /identity/v3/projects/7d8972923e014f219646c695fe706676/users/eb524d7cc7674ce2ade08297c0a2b874/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:36.451405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:36.469209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c950e4-6171-4530-9f2e-aa31f9a770a8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:36.628355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:36.629045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.629325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.629603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.630262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:36.631904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507eaae-b8e9-479b-ab78-403dd01efb38 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:36.655675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 848/1697] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:36.661105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:36.679361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0581-16b1-44c8-b86a-ba9f43c73c37 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:36.700078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:36.700928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.701311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.701698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] PATH_INFO: `/v3/projects/7d8972923e014f219646c695fe706676/users/eb524d7cc7674ce2ade08297c0a2b874/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.708662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8972923e014f219646c695fe706676, user_id=eb524d7cc7674ce2ade08297c0a2b874, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:36.730474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:36.758446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 850/1698] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:36 2022] PUT /identity/v3/projects/7d8972923e014f219646c695fe706676/users/eb524d7cc7674ce2ade08297c0a2b874/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:36.768927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:36.769465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:36.770134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:36.832954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] MFA Rules not processed for user `eb524d7cc7674ce2ade08297c0a2b874`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:36.834406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:36.989513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 849/1699] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:37.002428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:37.006278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:37.143821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230706c-3503-460a-8436-b4e8a7b880cc admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:37.152798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:37.153386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:37.153666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:37.153937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:37.173096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:37.177102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1cc5-6894-47a0-80c5-fb9a6133c233 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:37.212723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 851/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:37.318197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:37.319445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:37.323586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8ffe-9f83-4efe-98d5-0f6d6f27065a None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:37.323870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8ffe-9f83-4efe-98d5-0f6d6f27065a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:37.324142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f8ffe-9f83-4efe-98d5-0f6d6f27065a None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:37.325704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 852/1701] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 07:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:37.336045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:37.336330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:37.336629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:37.444065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:37.452086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:37.457601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:37.494607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:37.589332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 853/1702] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:00:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:00:37.590393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:37.591690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb51e0-a7be-4c9c-9997-481ecd76c841 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:37.592506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:37.618269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:37.619042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:37.619384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:37.619835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] PATH_INFO: `/v3/projects/1235a75d676c4817b992c320a22231a8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:37.626028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1235a75d676c4817b992c320a22231a8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:37.629313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0b12e-5eb5-46b6-8043-716eb2b76f3c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:37.630686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:37.643774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:37.644557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:37.644954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:37.645337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] PATH_INFO: `/v3/projects/f72d1cd6d9264b5f8f5931606bf6a9fd` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:37.657698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72d1cd6d9264b5f8f5931606bf6a9fd)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:37.659560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: WARNING py.warnings [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 07:00:37.659560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: warnings.warn(msg) Sep 13 07:00:37.659560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: Sep 13 07:00:37.661048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:37.743223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1235a75d676c4817b992c320a22231a8', 'request_id': 'req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.754339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1235a75d676c4817b992c320a22231a8', 'request_id': 'req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.775949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1235a75d676c4817b992c320a22231a8', 'request_id': 'req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.802859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] The token cache is being invalidate because project 1235a75d676c4817b992c320a22231a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:37.804514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.807417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.810086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 850/1703] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:37 2022] DELETE /identity/v3/projects/1235a75d676c4817b992c320a22231a8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:37.810666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:37.814045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:37.825716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72d1cd6d9264b5f8f5931606bf6a9fd', 'request_id': 'req-9c3bef18-27ee-41fd-beaa-2caca35f87ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.855048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72d1cd6d9264b5f8f5931606bf6a9fd', 'request_id': 'req-9c3bef18-27ee-41fd-beaa-2caca35f87ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.888996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72d1cd6d9264b5f8f5931606bf6a9fd', 'request_id': 'req-9c3bef18-27ee-41fd-beaa-2caca35f87ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.923164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] The token cache is being invalidate because project f72d1cd6d9264b5f8f5931606bf6a9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:37.924009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.929617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:37.932704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 854/1704] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:37 2022] DELETE /identity/v3/projects/f72d1cd6d9264b5f8f5931606bf6a9fd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:37.933733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:37.936400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.052778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a640-7c70-4d2f-b3c0-3a4b9d5504a7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:38.102954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bef18-27ee-41fd-beaa-2caca35f87ec admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:38.114107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:38.115180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.115610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.116046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] PATH_INFO: `/v3/projects/1d11e9f1451444cc8b7ceb250b544ed8` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.118498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d11e9f1451444cc8b7ceb250b544ed8)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:38.121233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:38.121814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:38.122514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.122862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.123247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.126210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.175734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:38.231542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:38.234735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:38.236187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d087e9-df4b-441e-9779-0a7fcd4bd63d service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:38.240051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d11e9f1451444cc8b7ceb250b544ed8', 'request_id': 'req-32a2a418-973a-4f09-8429-8401ab92cde8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.249998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 851/1705] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:38.251120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8a67-8ece-484a-9c02-010585c9c12e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.251532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8a67-8ece-484a-9c02-010585c9c12e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.251855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8a67-8ece-484a-9c02-010585c9c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.302705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d11e9f1451444cc8b7ceb250b544ed8', 'request_id': 'req-32a2a418-973a-4f09-8429-8401ab92cde8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.316994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d11e9f1451444cc8b7ceb250b544ed8', 'request_id': 'req-32a2a418-973a-4f09-8429-8401ab92cde8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.334164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3cfd8a67-8ece-484a-9c02-010585c9c12e None None] MFA Rules not processed for user `44aaf56f8bde416fab0bff2989d9c1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:38.335527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3cfd8a67-8ece-484a-9c02-010585c9c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.354705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] The token cache is being invalidate because project 1d11e9f1451444cc8b7ceb250b544ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:38.355146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.356570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.357927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 855/1706] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:37 2022] DELETE /identity/v3/projects/1d11e9f1451444cc8b7ceb250b544ed8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:38.362058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:38.368790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.462996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 852/1707] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:38.465314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaec2-052e-429d-bc03-19e070ff6d42 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.465968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaec2-052e-429d-bc03-19e070ff6d42 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.466655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefaec2-052e-429d-bc03-19e070ff6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.491760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2a418-973a-4f09-8429-8401ab92cde8 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:38.495677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:38.496293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.496718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.496994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.498941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.512182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:38.513970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ad3c0-77e1-4e73-8519-1531afa32457 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:38.528498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 856/1708] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:38.530037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.530514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.530854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.535901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fdefaec2-052e-429d-bc03-19e070ff6d42 None None] MFA Rules not processed for user `7e3a230224be4212aa18fe752a07bde2`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:38.537265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fdefaec2-052e-429d-bc03-19e070ff6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.572204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:38.581693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.711449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 857/1709] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:38.711449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:38.711449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.726744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 853/1710] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:38.727072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83fd8a-6769-437a-a6b2-a35ae8e3b8db None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:38.731972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.732495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.733087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.737426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:38.738347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:38.738692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:38.739026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] PATH_INFO: `/v3/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:38.740327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e62ea21d4d4bcdbd6a584bf1c6bde2)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:38.742370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:38.803924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] MFA Rules not processed for user `0ee62cef279e4a95bd9661306c319b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:38.807719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:38.831722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e62ea21d4d4bcdbd6a584bf1c6bde2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.853457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e62ea21d4d4bcdbd6a584bf1c6bde2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.855098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e62ea21d4d4bcdbd6a584bf1c6bde2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.855918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e62ea21d4d4bcdbd6a584bf1c6bde2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.870104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e62ea21d4d4bcdbd6a584bf1c6bde2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:38.878757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:38.881723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:38.906948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 858/1711] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:38 2022] DELETE /identity/v3/users/f8e62ea21d4d4bcdbd6a584bf1c6bde2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:38.907474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:38.911862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.000770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 854/1712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:39.000770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:39.003891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.057021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a2f0-0dca-4e89-9808-bf47fded2b56 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:39.062437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:39.064481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.064481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.065505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] PATH_INFO: `/v3/users/5ccc04128f15452b8fd214fcbbaddfc7` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.066811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccc04128f15452b8fd214fcbbaddfc7)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:39.069088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:39.142771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccc04128f15452b8fd214fcbbaddfc7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.154492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccc04128f15452b8fd214fcbbaddfc7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.156775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccc04128f15452b8fd214fcbbaddfc7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.157614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccc04128f15452b8fd214fcbbaddfc7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.165831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8c3c-f2f7-49c1-a5d8-75a1ba66452c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:39.168613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-97de5345-708c-4142-aa40-639930f0061b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccc04128f15452b8fd214fcbbaddfc7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.199520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 859/1713] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:38 2022] DELETE /identity/v3/users/5ccc04128f15452b8fd214fcbbaddfc7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:39.199520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8474-5318-483a-b351-642e203691c5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.199520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8474-5318-483a-b351-642e203691c5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.199520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b8474-5318-483a-b351-642e203691c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.230965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-eb6b8474-5318-483a-b351-642e203691c5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:39.234637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-eb6b8474-5318-483a-b351-642e203691c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.319058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:39.320150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.320634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.321255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.324954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.406684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 860/1714] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:39.408241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.408525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.409700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.418993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:39.436615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] MFA Rules not processed for user `0ee62cef279e4a95bd9661306c319b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:39.438024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.463008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:39.467028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:39.483390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 855/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:39.507183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:39.513781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.535283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 861/1716] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:39.540628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:39.560899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f89b7-cce0-4bd4-bab3-7170f2c9abf8 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:39.565865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b6a18-dff1-4d3f-9e51-4d6477342e3a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:39.577662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:39.578287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.578559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.578828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.579566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:39.579764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:39.582034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:39.583370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:39.624602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 862/1717] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:39.624602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:39.629539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.654124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a2778-0480-499c-895d-34d214dc24f5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:39.703503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:39.705432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.708407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.708785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] PATH_INFO: `/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.713804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1e7f83c8cc4225bb82cb193794bc9a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:39.716374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:39.830881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:39.831740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:39.832075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:39.832556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:39.836742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:39.902312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1e7f83c8cc4225bb82cb193794bc9a', 'request_id': 'req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.926386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1e7f83c8cc4225bb82cb193794bc9a', 'request_id': 'req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.935193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1e7f83c8cc4225bb82cb193794bc9a', 'request_id': 'req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.960746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] The token cache is being invalidate because project 9d1e7f83c8cc4225bb82cb193794bc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:39.961035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.964507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:39.967853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 863/1718] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:39 2022] DELETE /identity/v3/projects/9d1e7f83c8cc4225bb82cb193794bc9a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:39.968465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:39.971045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.078575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:40.080189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:40.096028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 856/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:40.097982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:40.113745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d784fd-5802-40f4-aa71-6a806da7589e service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:40.167943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87251-edb8-4e3d-ba1e-0feab6bd405d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:40.182713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:40.183645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.184229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.184857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.188406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.192373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:40.196382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.196382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.196382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.196382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:40.197721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c87f1-97f1-4e13-9f93-89a64f38403a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:40.215020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:40.218069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:40.252238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 864/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:40.255502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:40.257329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.314428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 857/1721] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:40 2022] POST /identity/v3/projects => generated 355 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:40.317230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:40.322412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc0bfb-a7d2-4e08-9f98-8411dec6b98c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.332803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc0bfb-a7d2-4e08-9f98-8411dec6b98c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.333290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc0bfb-a7d2-4e08-9f98-8411dec6b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.400888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6cbc0bfb-a7d2-4e08-9f98-8411dec6b98c None None] MFA Rules not processed for user `c28a4cfa6f3d4d43b949931468ccb4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:40.406577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6cbc0bfb-a7d2-4e08-9f98-8411dec6b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.547795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:40.618643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948cbaf-8069-4d75-aa17-0f8f240a81a0 service placement] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:40.711118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 858/1722] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:40.711118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.711118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.711118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.764003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:40.769897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.844017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:40.849171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.849409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.849702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.856503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.918058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 859/1723] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:40.919914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:40.922305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:40.952853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de464e9-d629-405b-b78c-720ce36c7811 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:40.964337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:40.965684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:40.966582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:40.966790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:40.967992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:40.969164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] PATH_INFO: `/v3/projects/4769722d27db4902ac10e0b86702265c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:40.972229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4769722d27db4902ac10e0b86702265c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:40.975223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:40.980506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 865/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:40.981553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:40.983018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:41.034461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48bc47-055f-4153-b158-0cf7edcc0f3c service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.058251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.061520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.062534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.062988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.067359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.073234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8c745-1527-47c6-8e2c-3868812bf8ea admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.094678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4769722d27db4902ac10e0b86702265c', 'request_id': 'req-6a0de84c-76ce-4ab8-ba15-034244396dd8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:41.105576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4769722d27db4902ac10e0b86702265c', 'request_id': 'req-6a0de84c-76ce-4ab8-ba15-034244396dd8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:41.127190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 866/1725] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:40 2022] POST /identity/v3/users => generated 278 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:41.128821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee14b-d705-4847-9c5d-4baa30c13da5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.129387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee14b-d705-4847-9c5d-4baa30c13da5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.130460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee14b-d705-4847-9c5d-4baa30c13da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.131738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4769722d27db4902ac10e0b86702265c', 'request_id': 'req-6a0de84c-76ce-4ab8-ba15-034244396dd8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:41.161633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] The token cache is being invalidate because project 4769722d27db4902ac10e0b86702265c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:41.163964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:41.165936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:41.168227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 860/1726] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:40 2022] DELETE /identity/v3/projects/4769722d27db4902ac10e0b86702265c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:41.169291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.178168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:41.186734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-643ee14b-d705-4847-9c5d-4baa30c13da5 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:41.189620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-643ee14b-d705-4847-9c5d-4baa30c13da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:41.240529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:41.321292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0de84c-76ce-4ab8-ba15-034244396dd8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.342284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 867/1727] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:41.343221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.343927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.344209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.344481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.345635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.345968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.346610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.347130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.350223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.356018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:41.380379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 861/1728] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:41.383276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.400903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:41.402619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:41.413401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70a00c-dca1-4cf0-acb4-6710f0a60084 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.429698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.430609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.431563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.431859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.432540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:41.432878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.435753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 868/1729] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:41.442024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.450325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6b3a-00bb-404e-b6ac-0803082ae5a4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.457275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28281df5-6bc3-4a7e-927e-675a61963b5a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.466050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.467092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.467471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.468305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.469322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.473991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.504795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 862/1730] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:41.504795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.506064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.517161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.523777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 869/1731] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:41.533914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.586834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93614be-f11e-469a-97b2-b1c9efe4d096 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.625229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.626401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.626687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.629736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.631376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.632668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:41.635724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:41.636948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.677730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 863/1732] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:41.689732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.716362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604c40-0c85-4f6d-81f7-185c3091ddc6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.725036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.725970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.726342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.726695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] PATH_INFO: `/v3/projects/2a5acd252fd74f1e8eb67b513782d9a1/users/9180ae843b314c8cbffb661a169c81e0/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.748375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 870/1733] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:41 2022] POST /identity/v3/projects => generated 401 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:41.749579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.757472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5acd252fd74f1e8eb67b513782d9a1, user_id=9180ae843b314c8cbffb661a169c81e0, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.765281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.788321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 864/1734] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:41 2022] PUT /identity/v3/projects/2a5acd252fd74f1e8eb67b513782d9a1/users/9180ae843b314c8cbffb661a169c81e0/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:41.789806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:41.948182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebc6e-92c6-4f0d-96b1-f77d02d216f6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:41.957524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:41.958339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:41.958629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:41.958902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:41.960743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:41.974903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:41.991421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666428-22e4-44a8-8e91-6a5c7aa2b7e5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:42.008160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:42.010165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.010465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.010789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.011469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:42.011773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:42.013940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295dd76-59ab-446f-98f2-ae1f5ac62e43 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:42.068277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 871/1735] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:42.075023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.079362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.080010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.087275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 865/1736] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:41 2022] POST /identity/v3/users => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:42.090171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:42.093664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.116203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae327-0d58-4a7f-921b-fe888cc6a354 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:42.124494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:42.125364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.131236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.131448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] PATH_INFO: `/v3/users/bf8c2c3ac77b41a5b08ae9155f677c7f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.133323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8c2c3ac77b41a5b08ae9155f677c7f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:42.137689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:42.155446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] MFA Rules not processed for user `9180ae843b314c8cbffb661a169c81e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:42.157642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.251203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8c2c3ac77b41a5b08ae9155f677c7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:42.269385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8c2c3ac77b41a5b08ae9155f677c7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:42.270286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8c2c3ac77b41a5b08ae9155f677c7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:42.271069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8c2c3ac77b41a5b08ae9155f677c7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:42.301990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8c2c3ac77b41a5b08ae9155f677c7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:42.345794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 872/1737] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:42.349029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:42.350792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 866/1738] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:42 2022] DELETE /identity/v3/users/bf8c2c3ac77b41a5b08ae9155f677c7f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:42.352629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.354701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:42.357047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.396081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863cc4e-a884-4b4b-9f74-c904fede165f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:42.409270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:42.415690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:42.615467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:42.615467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.615467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.616839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.617613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:42.625170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d064e-a409-48ae-a244-bbb5590e5faa admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:42.632616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c6e5-e72c-4341-bfaa-a2e1f9706633 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:42.658018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:42.659598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.659598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.659851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.660376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:42.668413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:42.723373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 867/1739] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:42.727221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:42.733808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.745403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 873/1740] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:42 2022] POST /identity/v3/projects => generated 389 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:42.751470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.751769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.757359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.771907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0327de-506e-46d9-8df0-0d43a609ff42 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:42.816849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:42.820510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:42.930394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:42.931138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:42.932968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:42.932968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:42.934483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:42.936743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24d9d-f27b-4069-b897-718673a80d73 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.027768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 868/1741] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:42 2022] POST /identity/v3/projects => generated 357 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:43.029660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc3a7-c80a-4205-9483-53b8474697e4 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.029945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc3a7-c80a-4205-9483-53b8474697e4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.030224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dc3a7-c80a-4205-9483-53b8474697e4 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.041995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 869/1742] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 07:00:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:43.043365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dc3a7-c80a-4205-9483-53b8474697e4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.102821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 874/1743] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:43.115215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.152558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1c3d-60a9-4ab3-b8ca-820339103277 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.213621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dc3a7-c80a-4205-9483-53b8474697e4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.237518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.238217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.238525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.238801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.239512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.245987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.278450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 870/1744] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:43.280450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.296057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753a2ae-8664-4b29-ace7-1cd18f4f2a79 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.303145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.304254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.304538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.304860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.305554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.307719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483ad1-8f55-4d5f-a533-d2947616d632 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.315564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.316424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.316514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.316888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.317542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.323312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.356837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 871/1745] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:43 2022] POST /identity/v3/users => generated 285 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:43.362768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.363271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.365822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.393801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 875/1746] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:43 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:43.397596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.402519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:43.416456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:43.420470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:43.448433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:43.478370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:43.542016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57426a8d-2deb-48b6-b5e1-7b1c7de50a09 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.554074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.554703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.554978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.555246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.582320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.586557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.593679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:00:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:43.594879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.613626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 876/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:43.614280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.622567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3023-4e13-4114-9c65-1a0a0231db0f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.635265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.636200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.636483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.636837 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] PATH_INFO: `/v3/projects/37f4f501486f4d0a86b625b814b92a5e/users/1e577d0f27f3484abdf6278c8b43b979/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.641532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45f95-e374-44e8-b555-216e3d6bbc04 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.655348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.655980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.656259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.656860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.657590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.662139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.677990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f4f501486f4d0a86b625b814b92a5e, user_id=1e577d0f27f3484abdf6278c8b43b979, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.687170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 877/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:43.689356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.691146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.713541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0652-fba1-4312-bd0e-e0312f3695b8 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.729116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.729354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.729452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.729760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.732399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.734695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fb84a-35b8-4537-978a-771299817ff7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:43.735232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 873/1750] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:43 2022] PUT /identity/v3/projects/37f4f501486f4d0a86b625b814b92a5e/users/1e577d0f27f3484abdf6278c8b43b979/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:43.737421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:43.782161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 878/1751] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:43.783611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.783864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.789091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.858061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] MFA Rules not processed for user `1e577d0f27f3484abdf6278c8b43b979`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:43.860135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:43.889546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e73e3-348e-42a2-aaba-40abf8e20611 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:43.904353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:43.905276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:43.906575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:43.911901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] PATH_INFO: `/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6/users/e0ceee1a793947c19741abd906dee74e/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:43.977025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80b368933b1496bb6a26ddc6fe6fbd6, user_id=e0ceee1a793947c19741abd906dee74e, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:43.985248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.032300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 874/1752] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:43 2022] PUT /identity/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6/users/e0ceee1a793947c19741abd906dee74e/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:44.033132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.082457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 879/1753] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:43 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:44.083989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.089727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:44.200722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb056b7-9e1c-47b8-b4fe-9a080453c93c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.213563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.213884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.214160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.214431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.215083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.217614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.242644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 875/1754] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:44.243708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.250667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fc41-416b-4d61-8101-7c788cd6a322 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.266268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32e70-020d-471f-bf93-6565fb2abba6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.275754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.276372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.276656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.276930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.277581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.280278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.307682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 876/1755] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:44.308955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.330710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204dc49-c0ff-4710-8c88-64ebdb28a1b9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.344267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.345841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.347111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.348794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.349666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.354109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.365409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.366015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.366015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.367122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.369858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:44.380222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:44.388728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.395217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.424824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 880/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:44.427150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.432779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 877/1757] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:44 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:44.435880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.463771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14dcc0-3cc6-438c-87d3-17b445c4994f service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.685346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48c721-4a89-4e1d-8932-3c76fd0fe2bf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:44.694542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.697696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.698535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.698820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] PATH_INFO: `/v3/projects/4779c5cd01604ca1a94054dfb5e88db4/users/5cb06ca9325d42f9be39af21f73bc11d/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.700001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:44.702349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.702678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.702953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] PATH_INFO: `/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6/users/e0ceee1a793947c19741abd906dee74e/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.708862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80b368933b1496bb6a26ddc6fe6fbd6, user_id=e0ceee1a793947c19741abd906dee74e, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.715772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.733845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4779c5cd01604ca1a94054dfb5e88db4, user_id=5cb06ca9325d42f9be39af21f73bc11d, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:44.740096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 878/1758] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:44 2022] PUT /identity/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6/users/e0ceee1a793947c19741abd906dee74e/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:44.742767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:44.743111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341b4f7-523a-42e2-8acb-003f343ac2c6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:44.816916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 881/1759] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:44 2022] PUT /identity/v3/projects/4779c5cd01604ca1a94054dfb5e88db4/users/5cb06ca9325d42f9be39af21f73bc11d/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:44.821189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1eb42-b241-4351-bac5-b0d146cd9d3d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:44.821698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1eb42-b241-4351-bac5-b0d146cd9d3d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:44.823266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1eb42-b241-4351-bac5-b0d146cd9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:44.978190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11ef9-7d0f-455b-a28a-27e6907a8305 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:45.046591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-77d1eb42-b241-4351-bac5-b0d146cd9d3d None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:45.056329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-77d1eb42-b241-4351-bac5-b0d146cd9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.145234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:45.146425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.146991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.148786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.150380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:45.153145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67e4b5-ca72-44fc-aa73-a3c54c2a9aa9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:45.227668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 879/1760] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:44 2022] POST /identity/v3/users => generated 307 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:45.229489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.229826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.230138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.265505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 882/1761] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:00:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:45.273569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.274105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.275896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.295798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] MFA Rules not processed for user `e0ceee1a793947c19741abd906dee74e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:45.297446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.318969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:45.374722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] MFA Rules not processed for user `5cb06ca9325d42f9be39af21f73bc11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:45.376178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.493867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:45.495873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 880/1762] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:45.497030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:45.503432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.531989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7f208-10ce-4cfb-9d0b-87bf18a644b0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:45.546359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:45.547392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.548769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.551870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] PATH_INFO: `/v3/projects/d0ce4a3c27e34fac8c98d048263bc5c2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.554526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ce4a3c27e34fac8c98d048263bc5c2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:45.566963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:45.609997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 883/1763] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:45.610982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:45.632299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385e8ee-814a-40d1-86dc-a7cd9c44d98c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:45.655953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:45.660268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.660780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.661258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.662606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:45.664623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85c19-71f0-4406-9922-018e178c5032 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:45.679258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 884/1764] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:45.680510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.680914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.681281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.697256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ce4a3c27e34fac8c98d048263bc5c2', 'request_id': 'req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:45.706983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] MFA Rules not processed for user `44aaf56f8bde416fab0bff2989d9c1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:45.708480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.726943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ce4a3c27e34fac8c98d048263bc5c2', 'request_id': 'req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:45.754319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ce4a3c27e34fac8c98d048263bc5c2', 'request_id': 'req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:45.786524 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] The token cache is being invalidate because project d0ce4a3c27e34fac8c98d048263bc5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:45.786853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:45.789212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:45.796544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 881/1765] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:45 2022] DELETE /identity/v3/projects/d0ce4a3c27e34fac8c98d048263bc5c2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:45.798258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:45.805727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.827325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 885/1766] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:45.828408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:45.830682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:45.918641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef4279-972d-428a-9bbb-0c5c0a5f4b2f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:45.923456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:45.924168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:45.924625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:45.924922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:45.929557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:46.075215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:46.137238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:46.139170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:46.168734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 882/1767] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:46.171465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:46.175547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:46.230399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d69e4-fb6e-4efc-9cd0-3179bf9eb75e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:46.245995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:46.246631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:46.246907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:46.247177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:46.251848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:46.341906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820eccf-910c-42e1-bbf9-79b7cfc1552d service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:46.356951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:46.358089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:46.358383 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:46.359492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:46.360209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:46.364178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:46.443611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:46.446653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:46.447088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 883/1768] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:46 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:46.448140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:46.448638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:46.452468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:46.464272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 886/1769] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:00:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:00:46.465960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:46.469626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:46.493793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d3934-1474-4fc6-967a-3ffe30cc1577 service swift] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:46.610277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:46.610997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:46.611193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:46.611466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] PATH_INFO: `/v3/users/eb524d7cc7674ce2ade08297c0a2b874` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:46.642257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb524d7cc7674ce2ade08297c0a2b874)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:46.655489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:46.712368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20958f8-d0c6-4a96-80c4-ac2751eadc45 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:46.732513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:46.734692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:46.735814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:46.738005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] PATH_INFO: `/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb/users/4b5cf244d3b94ea9808a6fc7ca4c437f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:46.825711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce84002a2c46fea1098e26d63a2aeb, user_id=4b5cf244d3b94ea9808a6fc7ca4c437f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:46.839327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:46.856296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb524d7cc7674ce2ade08297c0a2b874'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:46.875861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 884/1770] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:46 2022] PUT /identity/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb/users/4b5cf244d3b94ea9808a6fc7ca4c437f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:46.878176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:46.882309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb524d7cc7674ce2ade08297c0a2b874'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:46.883498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb524d7cc7674ce2ade08297c0a2b874'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:46.884446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb524d7cc7674ce2ade08297c0a2b874'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:46.910062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb524d7cc7674ce2ade08297c0a2b874'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:46.961176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:46 2022] DELETE /identity/v3/users/eb524d7cc7674ce2ade08297c0a2b874 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:46.961176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:46.965158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:47.083849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:47.135478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216c164-2a07-4244-994b-7e51f0a80561 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.262880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e40f2-f1d7-41db-8139-ed0188af19bd admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.280319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.281096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.281486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.281867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.282679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.287335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.370069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.371379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.371580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.371950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.375366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:47.399121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 888/1772] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:46 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:47.400666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:47.405666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:47.458787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:47.473314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74f2e1-ac72-4e4b-b228-7b90f99f3634 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.496552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.500520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.501160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.501785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.504729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.512917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.597189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 889/1773] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:47.600618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:47.662086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2374d2e-918f-462e-851e-b300a5196235 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.678290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.679664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.680073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.683491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.683734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.685386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.686194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.692190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.732964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 890/1774] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:47.735872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 885/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 859 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:47.736938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:47.751811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:47.786867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec60-d217-40e9-b5dc-9354b39ed25b service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.804556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bad63-061c-4490-9891-4d5f068313eb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:47.806659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.810172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.812683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.813107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] PATH_INFO: `/v3/projects/a151dd7d3198406c9784cfaa2c203d37/users/1c2e42eb1ac4431891fed28b61e144cd/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.819624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:47.821841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.824929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.826440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] PATH_INFO: `/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb/users/4b5cf244d3b94ea9808a6fc7ca4c437f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.832259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ce84002a2c46fea1098e26d63a2aeb, user_id=4b5cf244d3b94ea9808a6fc7ca4c437f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.847324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640d5f-785e-4928-92c3-7432a7b861ef admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.881932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151dd7d3198406c9784cfaa2c203d37, user_id=1c2e42eb1ac4431891fed28b61e144cd, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:47.893053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:47.910998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 891/1776] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:47 2022] PUT /identity/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb/users/4b5cf244d3b94ea9808a6fc7ca4c437f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:47.925487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:47.925860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:47.926139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:47.936489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 886/1777] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:47 2022] PUT /identity/v3/projects/a151dd7d3198406c9784cfaa2c203d37/users/1c2e42eb1ac4431891fed28b61e144cd/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:47.942988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:48.042965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] MFA Rules not processed for user `4b5cf244d3b94ea9808a6fc7ca4c437f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:48.044508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:48.158566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5ac2-0b1f-4975-ab84-a6151ba08cbe admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:48.182165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:48.182803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.183087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.187117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.187831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:48.197200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:48.222556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 887/1778] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:48.224838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:48.231014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:48.263357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b443cf-631a-4696-9115-ea6bf2c466dc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:48.280887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:48.281784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.282046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.282325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] PATH_INFO: `/v3/projects/7d8972923e014f219646c695fe706676` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.283875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8972923e014f219646c695fe706676)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:48.286407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:48.345738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:48.399951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8972923e014f219646c695fe706676', 'request_id': 'req-99c203b4-71c4-4a39-be20-e8364b9da96f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:48.413144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8972923e014f219646c695fe706676', 'request_id': 'req-99c203b4-71c4-4a39-be20-e8364b9da96f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:48.433700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8972923e014f219646c695fe706676', 'request_id': 'req-99c203b4-71c4-4a39-be20-e8364b9da96f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:48.461926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 892/1779] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:48.473898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:48.476088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] The token cache is being invalidate because project 7d8972923e014f219646c695fe706676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:48.476456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:48.478732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:48.485848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 888/1780] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:48 2022] DELETE /identity/v3/projects/7d8972923e014f219646c695fe706676 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:48.498406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:48.498406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:48.544888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c40255-a032-44a9-8c20-79ed826007dc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:48.671150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c203b4-71c4-4a39-be20-e8364b9da96f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:48.691487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:48.707717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.708092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.708280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.713470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:48.887710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:48.888427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.888689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.888959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] PATH_INFO: `/v3/projects/a151dd7d3198406c9784cfaa2c203d37/users/1c2e42eb1ac4431891fed28b61e144cd/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.909189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:48.912741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a685fc-a6a4-43e9-b28e-341c85d90277 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:48.916022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151dd7d3198406c9784cfaa2c203d37, user_id=1c2e42eb1ac4431891fed28b61e144cd, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:48.918831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc658-db47-473b-b1c3-2672ecd92ddd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:48.933283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 889/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:48.934496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e652b6-0323-4c71-91c8-c32af4ebf265 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.934895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e652b6-0323-4c71-91c8-c32af4ebf265 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.935239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e652b6-0323-4c71-91c8-c32af4ebf265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.955973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 893/1782] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:48 2022] PUT /identity/v3/projects/a151dd7d3198406c9784cfaa2c203d37/users/1c2e42eb1ac4431891fed28b61e144cd/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:48.955973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:48.955973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:48.955973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:48.967554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-68e652b6-0323-4c71-91c8-c32af4ebf265 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:48.969115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-68e652b6-0323-4c71-91c8-c32af4ebf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.027069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] MFA Rules not processed for user `7e3a230224be4212aa18fe752a07bde2`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:49.028152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.112882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:49.148002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 890/1783] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:49.149342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887ed1-c3b6-4ff4-95f1-63afe91c68bf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.149645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887ed1-c3b6-4ff4-95f1-63afe91c68bf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.152613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887ed1-c3b6-4ff4-95f1-63afe91c68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.179324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:49.220084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 894/1784] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:49.220723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:49.247617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-93887ed1-c3b6-4ff4-95f1-63afe91c68bf None None] MFA Rules not processed for user `1c2e42eb1ac4431891fed28b61e144cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:49.248968 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-93887ed1-c3b6-4ff4-95f1-63afe91c68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.430718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d632e3d-790d-4938-99f8-7575f820fb1d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:49.441628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:49.442699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.443002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.443280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.453609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.489399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 891/1785] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:49.490826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.491116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.491395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.536286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:49.537523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.558720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 892/1786] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:49.562617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:49.582484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab1e8e-68e0-41a0-b394-773c5afa793e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:49.592870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:49.593505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.593787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.594062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.594762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:49.595090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:49.598633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:49.603153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:49.605555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:49.626631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 893/1787] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:49.628015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:49.632597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:49.636951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 895/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:49 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:49.637948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:49.695965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2b518-232c-4305-956a-9c2331fa45e9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:49.701267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87815d81-d73c-4103-975d-e9f9f41c5a59 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:49.714825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:49.717298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.717553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.719718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.720467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:49.725414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:49.726053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:49.726341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:49.726636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:49.730115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:49.780391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:49.781882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5fdc-fd87-45a2-80ef-5b8a122182ac service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:49.832509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 896/1789] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:49 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:49.835124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:49.848404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 894/1790] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:50.095852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.096385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.097015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.123641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16f3c-4ee5-450b-b6f7-6c46126a6ef5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:50.147661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:50.148314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.148725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.149106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.155288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:50.160286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:50.177799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:50.185134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:50.253998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 897/1791] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:49 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:50.256035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:50.323451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f10b-9043-415a-89f3-d9e0e17d2f99 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:50.370438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:50.371123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.371357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.371607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.372267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:50.373896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:50.402868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 895/1792] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Sep 13 07:00:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:00:50.418542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:50.423441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:50.431392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 898/1793] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:50.433116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:50.473798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:50.473986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857715a-47b6-4a40-826d-43c11bcaac65 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:50.475303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1be41-9f05-446c-85a7-2d8c9fa232e7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:50.486263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:50.487958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.488797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.490176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.497067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:50.498121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.504269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.504847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.505724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:50.509687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:50.525940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:50.528753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bd6db-5d13-4f5d-bac4-e9b20e3214f2 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:50.558902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 899/1794] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:00:50.566034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:50.572896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 896/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:50.647638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc620-14ef-4bd6-8167-4e288af2c101 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:50.669333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:50.670235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.670705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.671161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] PATH_INFO: `/v3/projects/d26dba135ec44959b890e95c2c04cdc2/users/d37dad8e77a34fecbd500ffb69c38228/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.725720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26dba135ec44959b890e95c2c04cdc2, user_id=d37dad8e77a34fecbd500ffb69c38228, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:50.735816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:50.787989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 900/1796] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:50 2022] PUT /identity/v3/projects/d26dba135ec44959b890e95c2c04cdc2/users/d37dad8e77a34fecbd500ffb69c38228/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:50.801771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:50.802139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:50.802586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:50.868467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] MFA Rules not processed for user `d37dad8e77a34fecbd500ffb69c38228`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:50.872767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:51.026990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:51.107125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:51.108997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:51.137604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 897/1797] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:51.138979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:51.425242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e838a4-113e-45b5-89e2-52e260d0bb3b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:51.441116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:51.441819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:51.442105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:51.442382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:51.443042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:51.445025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:51.453507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71320ba9-0ca8-4daf-b86c-05a824fb7991 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:51.482472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:51.485614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:51.485768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:51.486029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] PATH_INFO: `/v3/users/5cb06ca9325d42f9be39af21f73bc11d` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:51.500962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb06ca9325d42f9be39af21f73bc11d)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:51.508336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:51.554584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 898/1798] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:51 2022] POST /identity/v3/projects => generated 375 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:51.555567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:51.686455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb06ca9325d42f9be39af21f73bc11d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:51.714318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb06ca9325d42f9be39af21f73bc11d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:51.714318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb06ca9325d42f9be39af21f73bc11d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:51.715189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb06ca9325d42f9be39af21f73bc11d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:51.744903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7a5b1a8d-a8b4-452b-a4c1-882b82b0c25d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb06ca9325d42f9be39af21f73bc11d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:51.823160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2efa69-ccbc-494b-96b7-672415bd102a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:51.826572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 901/1799] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:51 2022] DELETE /identity/v3/users/5cb06ca9325d42f9be39af21f73bc11d => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:51.828111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:51.828374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:51.829418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:51.917891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:51.928276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:52.105402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.106040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.106347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.106587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:52.107238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:52.115136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:52.131038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:52.186458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:52.215759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 902/1800] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:52.220307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:52.221504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 899/1801] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:51 2022] POST /identity/v3/users => generated 294 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:52.225633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:52.301479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97770-fba0-4124-8c64-c3fb00e35c70 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:52.329762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.332480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.336091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:52.338438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:52.341757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.344415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:52.349267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:52.355299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:52.395649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 903/1802] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:52.396940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:52.441433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b2aac-e6cf-4079-9e5a-73f367136690 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:52.460035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.461101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.461386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.461703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] PATH_INFO: `/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec/users/17d3171543d74535aabae740622eb788/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:52.520938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06c46695fee44e49a5c6ed23e7c21ec, user_id=17d3171543d74535aabae740622eb788, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:52.533164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:52.577186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3b132-f244-4bbe-b1fd-74c882a9ebed admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:52.595242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 904/1803] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:52 2022] PUT /identity/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec/users/17d3171543d74535aabae740622eb788/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:52.598166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:52.789053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.790197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.791387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.795059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:52.863782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0dc3a-1148-4e85-9d90-bcf1db02349a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:52.880172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.881144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.881431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.881712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:52.882419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:52.884278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:52.935400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 905/1804] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:52.941912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:52.977243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8210-6b4d-47e8-8240-54b1dec4db5d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:52.987656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:52.990631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20928-eeb9-490e-b031-f040b9ab145a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:52.992733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:52.994462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:52.996057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:52.997533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] PATH_INFO: `/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec/users/17d3171543d74535aabae740622eb788/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:53.001463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06c46695fee44e49a5c6ed23e7c21ec, user_id=17d3171543d74535aabae740622eb788, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:53.041877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:53.050098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 900/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:53.059434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 906/1806] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:52 2022] PUT /identity/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec/users/17d3171543d74535aabae740622eb788/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:53.070595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357529-300c-49c7-ae95-726d5c556d9f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:53.070880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357529-300c-49c7-ae95-726d5c556d9f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:53.071160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357529-300c-49c7-ae95-726d5c556d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:53.143180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9b357529-300c-49c7-ae95-726d5c556d9f None None] MFA Rules not processed for user `17d3171543d74535aabae740622eb788`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:53.146075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9b357529-300c-49c7-ae95-726d5c556d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:53.335763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:53.380925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 901/1807] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:53.391024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:53.393608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:53.576927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6911-bf58-4393-8f7a-42c979a1a377 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:53.589872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:53.591393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:53.591393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:53.594299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:53.603987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:53.827197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:53.873449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:53.877934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033323e-47e5-42f8-909f-3d80a96238e0 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:53.942103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 907/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:55.550718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:55.550718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:55.550718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:55.552025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 902/1809] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:00:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:55.578232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:55.578934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:55.578934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:55.634052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:55.638403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:55.763004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:55.766390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:55.890327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 908/1810] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:00:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:56.185817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:56.191300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:56.223606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0daf9-9408-4d65-9ae9-9ec3b0274ed1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:56.228086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a47ab6-376d-45e6-9a82-1f68baf3f4ac None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:56.256271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:56.256955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:56.257241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:56.257513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:56.267333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:56.273959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:56.274290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:56.274546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] PATH_INFO: `/v3/projects/4779c5cd01604ca1a94054dfb5e88db4` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:56.281033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4779c5cd01604ca1a94054dfb5e88db4)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:56.283833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:56.298929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:56.300493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:56.386141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 909/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:56.442138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4779c5cd01604ca1a94054dfb5e88db4', 'request_id': 'req-aa12015b-0fb2-4c9c-947a-57f2b8c11883'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.453223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4779c5cd01604ca1a94054dfb5e88db4', 'request_id': 'req-aa12015b-0fb2-4c9c-947a-57f2b8c11883'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.489249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4779c5cd01604ca1a94054dfb5e88db4', 'request_id': 'req-aa12015b-0fb2-4c9c-947a-57f2b8c11883'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.509852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] The token cache is being invalidate because project 4779c5cd01604ca1a94054dfb5e88db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:56.510498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.511398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.513530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 903/1812] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:55 2022] DELETE /identity/v3/projects/4779c5cd01604ca1a94054dfb5e88db4 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:56.518200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:56.534313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd46a-58d2-4b0e-8670-55b1b368bc71 service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:56.765403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:56.766094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:56.766468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:56.770189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] PATH_INFO: `/v3/users/1c2e42eb1ac4431891fed28b61e144cd` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:56.775899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2e42eb1ac4431891fed28b61e144cd)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:56.781376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:56.957985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2e42eb1ac4431891fed28b61e144cd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.976146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2e42eb1ac4431891fed28b61e144cd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.977430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2e42eb1ac4431891fed28b61e144cd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.978711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2e42eb1ac4431891fed28b61e144cd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:56.997817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0626bff6-2b9b-48c6-8c09-ab6d81dedf26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2e42eb1ac4431891fed28b61e144cd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.019997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:57.053951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 910/1813] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:56 2022] DELETE /identity/v3/users/1c2e42eb1ac4431891fed28b61e144cd => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:57.138606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:57.140019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:57.166806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12015b-0fb2-4c9c-947a-57f2b8c11883 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:57.384272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:57.384975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:57.385251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:57.391597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] PATH_INFO: `/v3/users/1e577d0f27f3484abdf6278c8b43b979` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:57.397440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e577d0f27f3484abdf6278c8b43b979)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:57.399445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:57.482995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:57.566861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e577d0f27f3484abdf6278c8b43b979'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.586996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e577d0f27f3484abdf6278c8b43b979'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.587628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e577d0f27f3484abdf6278c8b43b979'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.588301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e577d0f27f3484abdf6278c8b43b979'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.619465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e577d0f27f3484abdf6278c8b43b979'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:57.638633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 904/1814] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:00:57 2022] DELETE /identity/v3/users/1e577d0f27f3484abdf6278c8b43b979 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:57.643444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:57.644022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:57.644309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:57.666701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:57.668322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:57.812713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 911/1815] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:57.847076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:57.848932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:57.942978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:57.944610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:57.976321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5485e99-b822-4399-ab37-fb8b311ef840 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:57.993491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:57.995988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:57.997412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:57.998460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] PATH_INFO: `/v3/projects/a151dd7d3198406c9784cfaa2c203d37` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.001723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a151dd7d3198406c9784cfaa2c203d37)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:58.006302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:58.065759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937ca0-b278-4556-bd6b-0fb36fe67437 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:58.081863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:58.082720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.083163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.083620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.119161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:58.121783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:58.148385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 905/1816] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:58.150548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:58.152048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:58.213091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a151dd7d3198406c9784cfaa2c203d37', 'request_id': 'req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:58.244307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a151dd7d3198406c9784cfaa2c203d37', 'request_id': 'req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:58.265476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a151dd7d3198406c9784cfaa2c203d37', 'request_id': 'req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:58.301208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] The token cache is being invalidate because project a151dd7d3198406c9784cfaa2c203d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:00:58.301512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:58.308204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-37f5e7d4-534b-4f0c-a302-3ccabef18c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:00:58.309881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 912/1817] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:00:57 2022] DELETE /identity/v3/projects/a151dd7d3198406c9784cfaa2c203d37 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:00:58.314471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed182-7f6a-446d-a364-4abbee0afbc9 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.314949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed182-7f6a-446d-a364-4abbee0afbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.315477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed182-7f6a-446d-a364-4abbee0afbc9 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.316639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 913/1818] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:00:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:00:58.317700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce490-c9e1-4ef7-87fc-524ee328f486 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.317998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce490-c9e1-4ef7-87fc-524ee328f486 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.318267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bce490-c9e1-4ef7-87fc-524ee328f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.373601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad403a-7fe9-464a-82bd-5cda2dda4bf4 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:58.386631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e8bce490-c9e1-4ef7-87fc-524ee328f486 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:58.388072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e8bce490-c9e1-4ef7-87fc-524ee328f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:58.558092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 914/1819] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:58.559752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff0f7-9321-495d-b17a-1a516c1aa3ea None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.560184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff0f7-9321-495d-b17a-1a516c1aa3ea None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.560619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ff0f7-9321-495d-b17a-1a516c1aa3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.592038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:58.592720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.593117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.593451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.597497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:58.617070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:58.623652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-541ff0f7-9321-495d-b17a-1a516c1aa3ea None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:58.625286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-541ff0f7-9321-495d-b17a-1a516c1aa3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:58.647520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:00:58.776050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:58.778541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:58.794568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:00:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:58.796965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.798325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.799582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.807086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 906/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:58.839392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:58.840917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:58.851201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 916/1822] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:00:58.855541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:58.871885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028ddb-8c49-4e01-9607-b80df4f8fa0f service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:58.880511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:58.881464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.881836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.882644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.883978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:00:58.884360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:58.886396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:58.905336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 907/1823] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:00:58.910314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:58.926305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114b30d-2abc-483e-a33e-def3f4ae270b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:58.933742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:58.934979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:58.935517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:58.935926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:58.941088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:58.941088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.019426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:59.023529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:00:59.042676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 917/1824] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:00:58 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:00:59.044349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:59.069922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe473da-f5c9-4422-b131-1827a655f365 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:59.303754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-4893-4c1a-a419-baf3971a2d4b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:59.328895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:59.329525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.329810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.334211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.334919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:59.343503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.346551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:59.352258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.354196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.354196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.393902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:59.397756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.424305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 918/1825] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:00:59 2022] POST /identity/v3/users => generated 281 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:00:59.428118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:59.447342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829106-52a5-4e32-83d4-61119407aa81 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:59.447628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 908/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:00:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:00:59.463654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:59.464719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.465231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.465721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.466590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:59.468416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.489861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 919/1827] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:59.494269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:59.514686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f4cec-08d1-452f-9424-0810fe8ef1b0 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:59.537035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:59.538129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.538715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.540707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.544320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:59.550993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e4fc2-c782-43e9-a410-3b693ec4ce2f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.587557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 909/1828] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:00:59.591367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:00:59.615935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b969-1055-475d-bbab-70a3c229f245 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:00:59.645980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:00:59.647848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.648144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.648408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] PATH_INFO: `/v3/projects/8f0ba7be264243198eedd3f4f0c8aa52/users/16f09495d1fc408aab40162128a3081f/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.720773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0ba7be264243198eedd3f4f0c8aa52, user_id=16f09495d1fc408aab40162128a3081f, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:00:59.733965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:00:59.768027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 920/1829] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:00:59 2022] PUT /identity/v3/projects/8f0ba7be264243198eedd3f4f0c8aa52/users/16f09495d1fc408aab40162128a3081f/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:00:59.780460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:00:59.780714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:00:59.781344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:00:59.840196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] MFA Rules not processed for user `16f09495d1fc408aab40162128a3081f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:00:59.842103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:00.041172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:00.059522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 910/1830] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:00:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:00.103138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:00.105303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:00.173870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:00.227954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee0af-5870-42ad-b4ac-25a90c155b0a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:00.244721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:00.245360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:00.245636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:00.245914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:00.293211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:00.304395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:00.336874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 921/1831] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:00.371275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:00.515876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:00.517888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:00.626704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d1e1-285c-4c84-9f9f-6715290b77c3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:00.641755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:00.642424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:00.643924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:00.644212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] PATH_INFO: `/v3/users/16f09495d1fc408aab40162128a3081f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:00.680708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f09495d1fc408aab40162128a3081f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:00.682685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:00.704689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f9d4-9bf0-4299-90ea-21d28da1d49e service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:00.717430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:00.718878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:00.723723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:00.724335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] PATH_INFO: `/v3/projects/37f4f501486f4d0a86b625b814b92a5e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:00.726468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f4f501486f4d0a86b625b814b92a5e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:00.729011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:00.817251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f09495d1fc408aab40162128a3081f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.832937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f09495d1fc408aab40162128a3081f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.833760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f09495d1fc408aab40162128a3081f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.834954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f09495d1fc408aab40162128a3081f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.837356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f4f501486f4d0a86b625b814b92a5e', 'request_id': 'req-2a5e8198-d99e-41a7-a3de-ccad4747777c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.864596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f4f501486f4d0a86b625b814b92a5e', 'request_id': 'req-2a5e8198-d99e-41a7-a3de-ccad4747777c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.874838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f4f501486f4d0a86b625b814b92a5e', 'request_id': 'req-2a5e8198-d99e-41a7-a3de-ccad4747777c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.875290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b910d7a6-690a-4d5e-b624-a60643b2269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f09495d1fc408aab40162128a3081f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.896754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 911/1832] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:00 2022] DELETE /identity/v3/users/16f09495d1fc408aab40162128a3081f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:00.901656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:00.901936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:00.902272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:00.902713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] The token cache is being invalidate because project 37f4f501486f4d0a86b625b814b92a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:00.904899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.905597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:00.914174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 922/1833] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:00 2022] DELETE /identity/v3/projects/37f4f501486f4d0a86b625b814b92a5e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:00.916358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:00.920073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:00.973228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:00.984017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:01.226914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8198-d99e-41a7-a3de-ccad4747777c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:01.233370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 912/1834] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:01.247758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:01.248754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:01.249271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:01.250635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] PATH_INFO: `/v3/users/4b5cf244d3b94ea9808a6fc7ca4c437f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:01.254336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5cf244d3b94ea9808a6fc7ca4c437f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:01.256765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:01.291505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:01.435757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5cf244d3b94ea9808a6fc7ca4c437f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:01.450311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:01.454878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5cf244d3b94ea9808a6fc7ca4c437f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:01.455013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5cf244d3b94ea9808a6fc7ca4c437f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:01.456193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:01.456833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5cf244d3b94ea9808a6fc7ca4c437f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:01.508189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5cf244d3b94ea9808a6fc7ca4c437f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:01.514286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:01.567725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 923/1835] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:00 2022] DELETE /identity/v3/users/4b5cf244d3b94ea9808a6fc7ca4c437f => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:01.607880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742c64-8cdd-4389-8b4b-bdb50f54c7f2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:01.719299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:01.719978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:01.720259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:01.721330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:01.724804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:01.835430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:01.837101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25841-5309-4649-bd90-c6dd881987d3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:01.849403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 913/1836] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:02.053087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.054815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:02.101743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4647-3eaf-45bf-8118-4df976d523c1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.114514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.115251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.115648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.115991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] PATH_INFO: `/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.117233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ce84002a2c46fea1098e26d63a2aeb)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.119395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.188570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ce84002a2c46fea1098e26d63a2aeb', 'request_id': 'req-599a4674-980c-4b11-892f-5a86eeee2472'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.202352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ce84002a2c46fea1098e26d63a2aeb', 'request_id': 'req-599a4674-980c-4b11-892f-5a86eeee2472'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.210567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ce84002a2c46fea1098e26d63a2aeb', 'request_id': 'req-599a4674-980c-4b11-892f-5a86eeee2472'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.224792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] The token cache is being invalidate because project d2ce84002a2c46fea1098e26d63a2aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:02.225406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.226383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-599a4674-980c-4b11-892f-5a86eeee2472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.228395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 924/1837] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:02 2022] DELETE /identity/v3/projects/d2ce84002a2c46fea1098e26d63a2aeb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:02.235355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.235355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.235355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.259934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:02.261231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:02.355952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 914/1838] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:02.365787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.366171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.366380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.394800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:02.399443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:02.408911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 925/1839] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:02.412984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.428271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a447f-d5f4-41c9-a570-6bc392497dfb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.436231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.437008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.437327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.437613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.438277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:02.438585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.440249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.464223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 915/1840] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:02.468620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.483706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4764ed-d004-4639-a27a-76f6b98a0809 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.489701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.490397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.490751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.491118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.491849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.493883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.532616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 926/1841] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:02 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:02.536774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.552518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1cf14-55cc-4934-b959-03cd13981207 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.569736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:02.683081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.683860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.684149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.687610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.688389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.693126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.748237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 916/1842] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:02 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:02.753187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.773804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67f39-4986-4906-98bd-e8f21198ae02 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.790829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.793378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:02.819879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.820530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.820840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.821112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.821773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.823404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.841295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5914ff-e441-4e69-bd9d-ab1f7f42502c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.864774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.866256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.866707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.866991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] PATH_INFO: `/v3/projects/8f0ba7be264243198eedd3f4f0c8aa52` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.868533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0ba7be264243198eedd3f4f0c8aa52)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.874229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.892539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 927/1843] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:02.904403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.927340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f66fdd-7675-4653-839d-2971a64b2881 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:02.934599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:02.937579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:02.937780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:02.938064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:02.945147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:02.946706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:02.975783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 928/1844] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:02.979918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:02.984394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0ba7be264243198eedd3f4f0c8aa52', 'request_id': 'req-b09c8a2e-47ef-4016-96cb-24b93ecab39f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:02.996781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0ba7be264243198eedd3f4f0c8aa52', 'request_id': 'req-b09c8a2e-47ef-4016-96cb-24b93ecab39f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:03.004839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff71b1-68e8-4a85-bea1-58d4bf8ea029 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.008052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0ba7be264243198eedd3f4f0c8aa52', 'request_id': 'req-b09c8a2e-47ef-4016-96cb-24b93ecab39f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:03.023449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:03.077325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] The token cache is being invalidate because project 8f0ba7be264243198eedd3f4f0c8aa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:03.079237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:03.081673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09c8a2e-47ef-4016-96cb-24b93ecab39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:03.088691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 917/1845] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:02 2022] DELETE /identity/v3/projects/8f0ba7be264243198eedd3f4f0c8aa52 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:03.096288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76109-4d9e-44be-aed3-f0db3164cec2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.097105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76109-4d9e-44be-aed3-f0db3164cec2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.097397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f76109-4d9e-44be-aed3-f0db3164cec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.150854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f3f76109-4d9e-44be-aed3-f0db3164cec2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:03.152850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f3f76109-4d9e-44be-aed3-f0db3164cec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:03.164265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.166797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.167082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.168372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] PATH_INFO: `/v3/projects/ca52c3f66cb44a7bb9e1a289423ba274/users/746233e2db80459395cd066a949e369a/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.170366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 918/1846] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:03.181164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.181449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.181727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.203713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca52c3f66cb44a7bb9e1a289423ba274, user_id=746233e2db80459395cd066a949e369a, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.210281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f00c6a-dfa2-441d-831b-5bf35057332e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.239682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:03.241438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:03.257331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 929/1847] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:02 2022] PUT /identity/v3/projects/ca52c3f66cb44a7bb9e1a289423ba274/users/746233e2db80459395cd066a949e369a/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:03.260620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.260929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.261207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.323235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] MFA Rules not processed for user `746233e2db80459395cd066a949e369a`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:03.326048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:03.352052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 919/1848] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:03.356043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.380716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9bb0-5d0e-45b1-9828-7f16e3eda1ba None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.388962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.389866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.390302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.390965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.393912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:03.394445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.397479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.416400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 920/1849] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:03.421493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.439582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56e05-1ef5-448e-8e1c-8a77f31b5bef admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.449065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.451568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.452329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.452854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.453861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.458459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.459133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 930/1850] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:03.463741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.465228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:03.465729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:03.489127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3bc41-c4fe-4748-9c88-54490fe5c859 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.495413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.496044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.496319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.496606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.497265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.499223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.512181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 921/1851] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:03.517078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.536812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 931/1852] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:03.541200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.638815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3087c0-0791-4c82-ba0f-6ce9fa575cd6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.644312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.644970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.645250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.645524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.646196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.648273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.649903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1eb2a-3304-4283-a9a5-e9a4d944a519 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.655758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.656523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.656830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.657110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.658462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.661239 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.661926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:03.677999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 932/1853] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/users => generated 311 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:03.682347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.685707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 922/1854] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:03.694771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638280-4af7-4f76-8d69-12059f4fc6d1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.697128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.700003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.700648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.700983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.701381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.702350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.704691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.707949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32087-d943-4d2c-9b46-c7378dcf265f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.713045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.713678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.713954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.714222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.714861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.716438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.720358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 933/1855] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:03.722612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.733991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 923/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:03.734212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4af538-6b1d-472e-81af-3a05aeb7ee54 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.735619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.740937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.742657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.743103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.743827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] PATH_INFO: `/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d/users/64d5b6fdaca546d0af659f2907849f93/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.745727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f7d8-cce1-4a20-80e4-c125737a3c32 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.750272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.750867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.751145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.751415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.753064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.754466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.767059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 924/1857] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:01:03.768453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ce58d0f52c4edcb2bdc11aa004537d, user_id=64d5b6fdaca546d0af659f2907849f93, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.771530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.772008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.782696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d0-ac10-4225-a9fd-671a8f3d65ff admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.788105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.788822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.789101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.789363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] PATH_INFO: `/v3/projects/fc5117b6273443a784aa8afe258252df/users/01be750f880548f298b8780f8d4ff76c/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.799971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 934/1858] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:03 2022] PUT /identity/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d/users/64d5b6fdaca546d0af659f2907849f93/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:03.803884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:03.809562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5117b6273443a784aa8afe258252df, user_id=01be750f880548f298b8780f8d4ff76c, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.812386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc11f-0727-4031-9a7d-c7465b1d06ed admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.832762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 925/1859] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:03 2022] PUT /identity/v3/projects/fc5117b6273443a784aa8afe258252df/users/01be750f880548f298b8780f8d4ff76c/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:03.840301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.840714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.840992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.887885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1576-8f4c-4ae1-aa02-c3b0c86a76f6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:03.888096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] MFA Rules not processed for user `01be750f880548f298b8780f8d4ff76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:03.889639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:03.971512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:03.972380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:03.972877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:03.973300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:03.974505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:03.976216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:03.990010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 935/1860] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:03.993887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.017160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598897ae-b6a0-4fec-affd-5cefec560827 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.034256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.035024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.035394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.035668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] PATH_INFO: `/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d/users/64d5b6fdaca546d0af659f2907849f93/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.040188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ce58d0f52c4edcb2bdc11aa004537d, user_id=64d5b6fdaca546d0af659f2907849f93, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.041823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 926/1861] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:04.043157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db930b-74f4-463a-a5f5-5034c8e8b8ba admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.049734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.059830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 936/1862] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:03 2022] PUT /identity/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d/users/64d5b6fdaca546d0af659f2907849f93/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:04.075706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.076482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.077384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.089649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707a160-7d5a-4dae-9852-6df206e3deb3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.123992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:04.148131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] MFA Rules not processed for user `64d5b6fdaca546d0af659f2907849f93`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:04.150017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:04.199935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.201131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.201569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.202391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.207407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.209634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.227874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:04.273986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 927/1863] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:04.278122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.292320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 937/1864] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:04 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:04.307180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.311439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:04.388936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bafa3-7f1a-41fe-8e33-38be9f75636b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.394953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.395582 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.396379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.399081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.399081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.399614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.434901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 928/1865] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:04 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:04.439447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.449935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d76e77-802a-4160-9c9d-63327d8651b1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.460299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398affd-7072-4186-9258-0ffbf98bc5bf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.465588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.466391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.466948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.466948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.467579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.469379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.483857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 929/1866] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:04.489206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.511780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54d669-9270-42bc-9690-0e71b1c71c44 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.534227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.535497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.536669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.536963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.538023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.540385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.559712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.561443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 930/1867] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:04.561650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.561972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.562221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.569710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.581948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0c13-8562-4216-abf5-3926abf22627 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:04.587804 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:04.589133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.589600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.590037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] PATH_INFO: `/v3/projects/f8f284dd9daf453a888e2a7637c6e208/users/5b67c50ccba3435791d36d2d03285064/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.612982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f284dd9daf453a888e2a7637c6e208, user_id=5b67c50ccba3435791d36d2d03285064, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.617522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296cadd-5c18-4c89-9022-2a57cfe77b6c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.650884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 931/1868] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:04 2022] PUT /identity/v3/projects/f8f284dd9daf453a888e2a7637c6e208/users/5b67c50ccba3435791d36d2d03285064/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:04.662902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:04.663199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:04.663476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:04.688636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:04.696188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:04.720104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 938/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:04.741736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] MFA Rules not processed for user `5b67c50ccba3435791d36d2d03285064`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:04.745335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:04.830523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:04.889674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 932/1870] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:04.890755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:04.905272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e0e99-b550-4021-ad42-f45f5010cbff service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.044677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:05.066005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.115179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.117458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.117750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.118028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.118688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.130112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.176712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0036d44-e623-4c15-8d23-36ad8c96c4bb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.183209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.184085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.185981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.186614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.221874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 939/1871] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:04 2022] POST /identity/v3/projects => generated 385 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:05.226263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.318078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.319545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.338338 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 933/1872] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:05 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:05.353933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83014aae-0cb0-4667-8882-deb07bdef105 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.363631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.364453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.364823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.365288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.366226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.369559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.410793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 940/1873] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:05 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:05.412248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.426222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610086-b14e-43da-be3d-9d6afd700db9 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.432377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.433041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.433720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.433720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.434260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.436540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.454620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 934/1874] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:05.455949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.474319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9980623-683c-4ecb-8a9a-bdeabf99d234 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.483362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.484680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.485204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.486005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] PATH_INFO: `/v3/projects/27ec6a19d36f40bc9c8c554477ee9034/users/5a138db3617d4cf29751f9e4aec82888/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.512929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ec6a19d36f40bc9c8c554477ee9034, user_id=5a138db3617d4cf29751f9e4aec82888, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.516216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.540609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 941/1875] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:05 2022] PUT /identity/v3/projects/27ec6a19d36f40bc9c8c554477ee9034/users/5a138db3617d4cf29751f9e4aec82888/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:05.544935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.560785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa9b0-80a8-4f58-86c4-f09d9f4d9c7c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.645428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.646160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.646533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.646918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.647661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.649385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a3f2f-02a1-438a-90be-c38ce63f246e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.662516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 935/1876] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:05.666392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.678850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d596f-1cc1-4e06-aef1-323aa7a48f88 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.684747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.685424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.685708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.685984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] PATH_INFO: `/v3/projects/27ec6a19d36f40bc9c8c554477ee9034/users/5a138db3617d4cf29751f9e4aec82888/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.687941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ec6a19d36f40bc9c8c554477ee9034, user_id=5a138db3617d4cf29751f9e4aec82888, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:05.691239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:05.714051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 942/1877] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:05 2022] PUT /identity/v3/projects/27ec6a19d36f40bc9c8c554477ee9034/users/5a138db3617d4cf29751f9e4aec82888/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:05.724868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b271-87d5-40bd-bdcc-0f81a7c8d257 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.725179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b271-87d5-40bd-bdcc-0f81a7c8d257 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.725691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b271-87d5-40bd-bdcc-0f81a7c8d257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:05.761185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0c25b271-87d5-40bd-bdcc-0f81a7c8d257 None None] MFA Rules not processed for user `5a138db3617d4cf29751f9e4aec82888`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:05.762443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0c25b271-87d5-40bd-bdcc-0f81a7c8d257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:05.767824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:05.852522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 936/1878] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:05.867143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:05.967839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489886db-5c42-4020-9bae-1c29d7d3eaef admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:05.980994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:05.981740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:05.982118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:05.983015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:06.044669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:06.086130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:06.086661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f40f5-f199-4978-9deb-6a726491ba74 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:06.100529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 943/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:07.473742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:07.479226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:07.479502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:07.481232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 937/1880] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:01:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:01:07.490215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:07.490732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:07.490999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:07.514436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:07.516137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:07.603033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 944/1881] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:01:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:07.615606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:07.617783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:07.642054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587cfef-c187-4cfc-af00-74ad96f45e22 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:07.649508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:07.650280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:07.650628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:07.650977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:07.661675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:07.663657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:07.675948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 938/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:07.859540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:07.861824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:07.879783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d479c-cc18-4047-8c3f-dd2307caa935 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:07.887037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:07.888792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:07.904529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:07.906913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:07.907402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:07.909661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.036116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:08.043311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca443-8906-4065-a768-64b3d8d1a777 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:08.044084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4df6-7f08-48e0-8c28-3b8f6ca8c4c3 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:08.049422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:08.050534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:08.051089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:08.051826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] PATH_INFO: `/v3/users/9180ae843b314c8cbffb661a169c81e0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.053454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9180ae843b314c8cbffb661a169c81e0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:08.055935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:08.056628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 945/1883] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:08.123518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9180ae843b314c8cbffb661a169c81e0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:08.136095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9180ae843b314c8cbffb661a169c81e0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:08.137237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9180ae843b314c8cbffb661a169c81e0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:08.138098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9180ae843b314c8cbffb661a169c81e0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:08.155377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9180ae843b314c8cbffb661a169c81e0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:08.179422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 939/1884] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:07 2022] DELETE /identity/v3/users/9180ae843b314c8cbffb661a169c81e0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:08.184418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:08.184746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:08.185007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.213657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:08.216364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:08.341961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 946/1885] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:08.352514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:08.354881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:08.374880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:08.446649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af87fa-6cd5-4857-9138-ecea745c7ebf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:08.453540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:08.454257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:08.454528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:08.454949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.465426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:08.467060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:08.479298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 940/1886] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:08.898040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:08.900304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:08.909928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:08.933137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:08.935175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:08.962009 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4026-4108-49ea-af00-f571e83d7259 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:08.974056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:08.974759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:08.975046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:08.975487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] PATH_INFO: `/v3/projects/2a5acd252fd74f1e8eb67b513782d9a1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.976658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5acd252fd74f1e8eb67b513782d9a1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:08.986962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:08.987997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c18edb-2857-4c5f-b912-7ac1cb067b9e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:08.993198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:08.993825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:08.994107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:08.995920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:08.997834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:09.089546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5acd252fd74f1e8eb67b513782d9a1', 'request_id': 'req-8d6be1c5-ff0e-407d-b105-2551848a2e13'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.109707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5acd252fd74f1e8eb67b513782d9a1', 'request_id': 'req-8d6be1c5-ff0e-407d-b105-2551848a2e13'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.130998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5acd252fd74f1e8eb67b513782d9a1', 'request_id': 'req-8d6be1c5-ff0e-407d-b105-2551848a2e13'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.144599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:09.146609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:09.153157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] The token cache is being invalidate because project 2a5acd252fd74f1e8eb67b513782d9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:09.153452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.155408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.158648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 941/1887] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:08 2022] DELETE /identity/v3/projects/2a5acd252fd74f1e8eb67b513782d9a1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:09.165739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:09.170339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:09.172987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 947/1888] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:09.338324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6be1c5-ff0e-407d-b105-2551848a2e13 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:09.347090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:09.348096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:09.348096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:09.348278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] PATH_INFO: `/v3/users/e0ceee1a793947c19741abd906dee74e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:09.349557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ceee1a793947c19741abd906dee74e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:09.351877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:09.417295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:09.435312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ceee1a793947c19741abd906dee74e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.449685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ceee1a793947c19741abd906dee74e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.450323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ceee1a793947c19741abd906dee74e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.451002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ceee1a793947c19741abd906dee74e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.493583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac1e3610-9d22-414e-a49d-24b0ad7bed69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ceee1a793947c19741abd906dee74e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:09.526404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 942/1889] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:09 2022] DELETE /identity/v3/users/e0ceee1a793947c19741abd906dee74e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:09.982943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:09.998478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca508f-4850-49e9-b5a7-8b775ab0d229 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.073629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.074453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.076752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.077123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] PATH_INFO: `/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.078783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80b368933b1496bb6a26ddc6fe6fbd6)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.082073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.150093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80b368933b1496bb6a26ddc6fe6fbd6', 'request_id': 'req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:10.161388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80b368933b1496bb6a26ddc6fe6fbd6', 'request_id': 'req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:10.162649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:10.169047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80b368933b1496bb6a26ddc6fe6fbd6', 'request_id': 'req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:10.184107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] The token cache is being invalidate because project d80b368933b1496bb6a26ddc6fe6fbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:10.184549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:10.185454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fa4e40fb-36d1-4816-a0a6-1eb1aad66167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:10.187146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 948/1890] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:09 2022] DELETE /identity/v3/projects/d80b368933b1496bb6a26ddc6fe6fbd6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:10.192162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.192625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.193223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.215553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:10.216858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:10.291205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 943/1891] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:10.301190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.301478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.301756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.322156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:10.323491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:10.332260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 949/1892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:10.336542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.347290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac7f1-6d6d-47da-8bdc-a617b849f0ce None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.353295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.353913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.354348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.354470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.355109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:10.355827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.357060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.373668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 944/1893] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:10.374901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.390723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af61be2-6b59-4546-8dd4-cecf5b04ee9f None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.396330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.396616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.397077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.397355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.397999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.399902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.439734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 950/1894] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:10.440962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.452302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862535a9-54c2-4373-a2b1-34be04523d59 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.526155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.526780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.527195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.527619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.528483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.530617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.554836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 945/1895] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:10.559134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.570418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daf5dd-94ca-4a1e-b544-1b1ba87c6a52 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.575398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.576112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.576395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.576694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.577344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.578928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.590493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 951/1896] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:10.594486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.606448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753a9d9-da33-4b94-90e6-e4625eb3b56d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.612820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.613718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.614057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.614563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.615350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.617002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173f00-0a3f-4c73-9d3d-61b80315bc00 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.635366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 946/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:10.635766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.646902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b190fac-979a-4a98-8d91-9b09e1b22c9d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:10.677809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:10.678871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.679188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.679466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] PATH_INFO: `/v3/projects/777d704edec94fc4ba3e03cf3832bfe2/users/d97d79a0f4564b779fada6faf60a3ba0/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.700989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777d704edec94fc4ba3e03cf3832bfe2, user_id=d97d79a0f4564b779fada6faf60a3ba0, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:10.703907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:10.732825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 952/1898] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:10 2022] PUT /identity/v3/projects/777d704edec94fc4ba3e03cf3832bfe2/users/d97d79a0f4564b779fada6faf60a3ba0/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:10.748068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:10.748441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:10.748690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:10.817264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] MFA Rules not processed for user `d97d79a0f4564b779fada6faf60a3ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:10.818854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:10.827302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:10.911005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 947/1899] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:10.915436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:10.992964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3d1b-b7e4-401e-9480-126728161601 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.005383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.006082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.006429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.006777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.007526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.009782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.044444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 953/1900] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:10 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:11.049079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.062506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5061125-5bc1-45a9-8d23-af49a5b08e02 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.136137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.137481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.137890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.138526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.139142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.155671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.220175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 948/1901] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:11 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:11.221091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.236720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cced7-02a8-4a8d-a309-fed586bc0be0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.242894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.243721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.244161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.244766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.245865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.248013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.269992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 954/1902] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:01:11.274480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.295954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033203c7-4cf9-460c-96b4-32f291a35666 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.321182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.323020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.323303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.323650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] PATH_INFO: `/v3/projects/eb9440eaa9884e08bfe558e7ed110f61/users/abdac79bfcbf4d4cb9ac34b8217f5623/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.348552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9440eaa9884e08bfe558e7ed110f61, user_id=abdac79bfcbf4d4cb9ac34b8217f5623, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.352039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.371055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 949/1903] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:11 2022] PUT /identity/v3/projects/eb9440eaa9884e08bfe558e7ed110f61/users/abdac79bfcbf4d4cb9ac34b8217f5623/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:11.378512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.390154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4add3-6baa-4b1e-9a1c-6fa9ac183fec admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.461605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:11.470835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.471826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.472180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.472772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.473305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.475613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29f7c8-ada7-42b2-a44e-1c8f283dcc22 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.493361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 955/1904] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:11.497924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.514749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9a852-7084-4a15-a098-30cf5d732b35 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.530861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.531469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.531469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.531678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] PATH_INFO: `/v3/projects/eb9440eaa9884e08bfe558e7ed110f61/users/abdac79bfcbf4d4cb9ac34b8217f5623/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.535706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9440eaa9884e08bfe558e7ed110f61, user_id=abdac79bfcbf4d4cb9ac34b8217f5623, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.539088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.567173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 950/1905] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:11 2022] PUT /identity/v3/projects/eb9440eaa9884e08bfe558e7ed110f61/users/abdac79bfcbf4d4cb9ac34b8217f5623/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:11.580739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.581092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.581319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.591136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.593606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:11.622813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] MFA Rules not processed for user `abdac79bfcbf4d4cb9ac34b8217f5623`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:11.624141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:11.679486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47c0f-ab11-422e-9cad-b9a02bf9bfec admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.689590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:11.690818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.691135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.691406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] PATH_INFO: `/v3/users/746233e2db80459395cd066a949e369a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.693123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746233e2db80459395cd066a949e369a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:11.697067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:11.699302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:11.740646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 956/1906] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:11.742267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:11.778398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:11.805370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746233e2db80459395cd066a949e369a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:11.829014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746233e2db80459395cd066a949e369a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:11.830827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746233e2db80459395cd066a949e369a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:11.831494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746233e2db80459395cd066a949e369a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:11.847287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ec03c31-a403-47ca-a9ac-6cf19fc09353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746233e2db80459395cd066a949e369a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:11.902873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 951/1907] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:11 2022] DELETE /identity/v3/users/746233e2db80459395cd066a949e369a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:11.913976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:11.914422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:11.915148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:11.934635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251851a-7882-464e-8ff0-25863be64bc3 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:11.960259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:11.969122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.038523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:12.039202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:12.039488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:12.039756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:12.045651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.118297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 952/1908] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:12.134154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:12.135663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.146749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:12.181068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:12.182570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:12.201405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 957/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:12.226642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a2158-09f9-489b-a2ba-c64b91cdec0f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:12.234721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:12.235824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:12.235824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:12.236808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:12.253429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:12.254888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:12.287064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 953/1910] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:12.323281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:12.323281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.327258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4445b-de7b-40ce-ba6e-0d5826f3748c service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:12.331968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:12.332771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:12.333050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:12.333367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:12.335441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.429040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:12.436199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:12.478465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 958/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:12.829537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:12.832190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:12.862440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87ee50-422b-421f-b2ed-c3a4ffd830e8 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:12.874872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:12.875528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:12.875835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:12.876111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] PATH_INFO: `/v3/projects/ca52c3f66cb44a7bb9e1a289423ba274` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:12.883598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca52c3f66cb44a7bb9e1a289423ba274)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:12.886130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:12.938393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:13.020137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca52c3f66cb44a7bb9e1a289423ba274', 'request_id': 'req-e960d4aa-a276-4ddc-83f3-752585afeb9f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.049818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca52c3f66cb44a7bb9e1a289423ba274', 'request_id': 'req-e960d4aa-a276-4ddc-83f3-752585afeb9f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.079264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca52c3f66cb44a7bb9e1a289423ba274', 'request_id': 'req-e960d4aa-a276-4ddc-83f3-752585afeb9f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.100243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] The token cache is being invalidate because project ca52c3f66cb44a7bb9e1a289423ba274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:13.100432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.102568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.104401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 954/1912] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:12 2022] DELETE /identity/v3/projects/ca52c3f66cb44a7bb9e1a289423ba274 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:13.110128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:13.140231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb91610-f3b5-4a22-8046-c45f046ad0b8 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:13.228045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:13.228851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:13.229154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:13.229426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] PATH_INFO: `/v3/users/64d5b6fdaca546d0af659f2907849f93` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:13.230583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d5b6fdaca546d0af659f2907849f93)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:13.232625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:13.285104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d5b6fdaca546d0af659f2907849f93'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.293050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d5b6fdaca546d0af659f2907849f93'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.293838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d5b6fdaca546d0af659f2907849f93'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.294521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d5b6fdaca546d0af659f2907849f93'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.301875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d5b6fdaca546d0af659f2907849f93'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.328939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:13.334382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 959/1913] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:13 2022] DELETE /identity/v3/users/64d5b6fdaca546d0af659f2907849f93 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:13.598226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:13.599884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:13.614527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d4aa-a276-4ddc-83f3-752585afeb9f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:13.684126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:13.684778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:13.685052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:13.685342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] PATH_INFO: `/v3/users/01be750f880548f298b8780f8d4ff76c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:13.686458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01be750f880548f298b8780f8d4ff76c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:13.688408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:13.747345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01be750f880548f298b8780f8d4ff76c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.756299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01be750f880548f298b8780f8d4ff76c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.756973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01be750f880548f298b8780f8d4ff76c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.757636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01be750f880548f298b8780f8d4ff76c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.772027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2a5731ae-171f-4093-823c-89b75d336278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01be750f880548f298b8780f8d4ff76c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.788291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:13.791646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 955/1914] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:13 2022] DELETE /identity/v3/users/01be750f880548f298b8780f8d4ff76c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:13.793361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:13.793504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:13.793778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:13.794054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:13.821690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0256e-4834-407a-ae74-e1fb8735065b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:13.825197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:13.826398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:13.846931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:13.879910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:13.880546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:13.880859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:13.881128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] PATH_INFO: `/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:13.882245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ce58d0f52c4edcb2bdc11aa004537d)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:13.884219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:13.894965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 956/1915] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:13.896540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:13.898289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:13.913332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d982e0-d7d4-481b-a200-63980caa6b4b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:13.930454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:13.932013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:13.932298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:13.932691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] PATH_INFO: `/v3/users/d37dad8e77a34fecbd500ffb69c38228` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:13.933936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37dad8e77a34fecbd500ffb69c38228)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:13.938286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:13.959100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ce58d0f52c4edcb2bdc11aa004537d', 'request_id': 'req-15839fbb-c6b2-4846-8d4c-9f6650d4729c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.967877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ce58d0f52c4edcb2bdc11aa004537d', 'request_id': 'req-15839fbb-c6b2-4846-8d4c-9f6650d4729c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.974907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ce58d0f52c4edcb2bdc11aa004537d', 'request_id': 'req-15839fbb-c6b2-4846-8d4c-9f6650d4729c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.987892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] The token cache is being invalidate because project 12ce58d0f52c4edcb2bdc11aa004537d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:13.988186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.989358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:13.991066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 960/1916] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:13 2022] DELETE /identity/v3/projects/12ce58d0f52c4edcb2bdc11aa004537d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:13.992016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:13.993635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.008518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37dad8e77a34fecbd500ffb69c38228'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:14.018067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37dad8e77a34fecbd500ffb69c38228'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:14.024541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37dad8e77a34fecbd500ffb69c38228'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:14.025248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37dad8e77a34fecbd500ffb69c38228'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:14.037852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-144a9472-0798-40f2-af40-e4dd019da03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37dad8e77a34fecbd500ffb69c38228'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:14.051535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 957/1917] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:13 2022] DELETE /identity/v3/users/d37dad8e77a34fecbd500ffb69c38228 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:14.052897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f647-035f-469e-9ac2-b4bab3ab38ea None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.053181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f647-035f-469e-9ac2-b4bab3ab38ea None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.053454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f647-035f-469e-9ac2-b4bab3ab38ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.058756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15839fbb-c6b2-4846-8d4c-9f6650d4729c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.075056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-08d7f647-035f-469e-9ac2-b4bab3ab38ea None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:14.076261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-08d7f647-035f-469e-9ac2-b4bab3ab38ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.104338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:14.112358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.113786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.114312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.114670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.117013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.137781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 958/1918] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:14.139279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480a40-b82f-4361-913e-df816bc35da3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.139400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480a40-b82f-4361-913e-df816bc35da3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.139581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480a40-b82f-4361-913e-df816bc35da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.162180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-84480a40-b82f-4361-913e-df816bc35da3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:14.163395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-84480a40-b82f-4361-913e-df816bc35da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.181702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 959/1919] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:14.182848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.183139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.183417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.192432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.194009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.210635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:14.211462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 961/1920] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:14.211948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.212723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.214390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:14.224004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 960/1921] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:14.228743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688b0a-c5bb-48bf-9004-1dc10759f2eb service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.233135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.233766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.234500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.234500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.242584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.248424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.250908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.262422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04637ebb-3ba4-4997-a378-3e57a69b8408 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.268363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 962/1922] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:14.276617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.277220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.277336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.277594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.278255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:14.278560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.280615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.299304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 961/1923] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:14.304528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.318744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836c28f-cce9-4b5e-b42f-c039fad2f1dc service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.324386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.325191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.325488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.325763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.326695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.329702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.376764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 963/1924] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:14.380028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.402721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffb886-0708-4f57-b21d-95515e2fa5e8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.415595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:14.534514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.535138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.535420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.535698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.543611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.545975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.615324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 962/1925] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:14.619443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.639610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e881-4418-4934-b886-090eec8e681b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.658647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.660208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.660557 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.660944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.661613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.664277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.696701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 964/1926] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:14.700709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.731231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710be3-e6c3-420a-b964-d80c5f7ba823 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.746317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.746984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.747305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.748755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.751145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.755618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f05fa4-0ca1-4512-a987-f688f8f00725 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.774309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 963/1927] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:14.778794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:14.794191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a604ce-98ba-43a5-8af1-87ae0a88be05 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:14.802298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:14.803347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.804286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.804486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] PATH_INFO: `/v3/projects/01dc09e152c2464e89148b1ec645ca2a/users/ed6edb7f91b9441b924555b1e01f1976/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.827212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01dc09e152c2464e89148b1ec645ca2a, user_id=ed6edb7f91b9441b924555b1e01f1976, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:14.838694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:14.882505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 965/1928] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:14 2022] PUT /identity/v3/projects/01dc09e152c2464e89148b1ec645ca2a/users/ed6edb7f91b9441b924555b1e01f1976/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:14.894766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:14.895390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:14.895865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:14.952570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] MFA Rules not processed for user `ed6edb7f91b9441b924555b1e01f1976`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:14.959403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.099444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 964/1929] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:15.103267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.213332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.215924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.238353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454901be-609f-4ea0-bdd3-6133984f13c0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.248906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.249253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.249539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.249814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.250492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.258960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.308320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 966/1930] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:15 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:15.312436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.316291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981018-ad37-4964-8b0e-2fc1cef5346f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.327491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:15.344924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:15.382592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.383235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.383509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.384054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] PATH_INFO: `/v3/projects/fc5117b6273443a784aa8afe258252df` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.384906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5117b6273443a784aa8afe258252df)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.386870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.395781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d200-e913-47f2-b167-c2957907e7ff admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.401081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.401633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.401915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.402190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.402826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.404788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.440539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 967/1931] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:15 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:15.444006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.448372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5117b6273443a784aa8afe258252df', 'request_id': 'req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.456827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5117b6273443a784aa8afe258252df', 'request_id': 'req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.461438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4d09-5c38-44ba-b245-11f95b794a6a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.467718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5117b6273443a784aa8afe258252df', 'request_id': 'req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.484142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] The token cache is being invalidate because project fc5117b6273443a784aa8afe258252df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:15.484715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.485533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.490761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 965/1932] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:15 2022] DELETE /identity/v3/projects/fc5117b6273443a784aa8afe258252df => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:15.491879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.494427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.561463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.562378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.562831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.563286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.565097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.566801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.572114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94e7ed-38d1-4756-80d3-9083cd8fe9c7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.577763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.582008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.582008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.582008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] PATH_INFO: `/v3/users/5b67c50ccba3435791d36d2d03285064` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.582008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b67c50ccba3435791d36d2d03285064)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.582350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 968/1933] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:15.582350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.582516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.583474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.596353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3640c-ec1c-405e-90c4-a49b2f10aa05 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.601348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.601985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.602266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.602540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] PATH_INFO: `/v3/projects/d26dba135ec44959b890e95c2c04cdc2` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.604525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26dba135ec44959b890e95c2c04cdc2)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.606482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.645581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b67c50ccba3435791d36d2d03285064'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.657041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b67c50ccba3435791d36d2d03285064'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.659328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b67c50ccba3435791d36d2d03285064'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.660366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b67c50ccba3435791d36d2d03285064'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.666878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:15.691072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b67c50ccba3435791d36d2d03285064'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.713943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 966/1934] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:15 2022] DELETE /identity/v3/users/5b67c50ccba3435791d36d2d03285064 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:15.714997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.716538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.724376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26dba135ec44959b890e95c2c04cdc2', 'request_id': 'req-cda06fbb-5a89-4ded-aafe-8517230a6838'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.747597 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26dba135ec44959b890e95c2c04cdc2', 'request_id': 'req-cda06fbb-5a89-4ded-aafe-8517230a6838'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.760719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26dba135ec44959b890e95c2c04cdc2', 'request_id': 'req-cda06fbb-5a89-4ded-aafe-8517230a6838'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.784745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] The token cache is being invalidate because project d26dba135ec44959b890e95c2c04cdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:15.785048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.785788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:15.791694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 969/1935] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:15 2022] DELETE /identity/v3/projects/d26dba135ec44959b890e95c2c04cdc2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:15.796134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.802153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.839550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:15.859923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5af720-00b8-43cb-aebe-5018541ddf28 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:15.868924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:15.870468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:15.871026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:15.871577 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] PATH_INFO: `/v3/projects/1d603b1706df432a94ca7503518cce5b/users/468c4c65fca546c08bb5f041c972dbee/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:15.896874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d603b1706df432a94ca7503518cce5b, user_id=468c4c65fca546c08bb5f041c972dbee, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:15.896874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:15.931627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 967/1936] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:15 2022] PUT /identity/v3/projects/1d603b1706df432a94ca7503518cce5b/users/468c4c65fca546c08bb5f041c972dbee/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:15.932102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:15.934359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:15.948934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06fbb-5a89-4ded-aafe-8517230a6838 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.067589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.070251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.072947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.073510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] PATH_INFO: `/v3/users/17d3171543d74535aabae740622eb788` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.075640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d3171543d74535aabae740622eb788)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.078635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.100426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061621e-7f06-4911-be51-4219c4f0d02a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.111221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.116509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.117081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.117459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.118269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.120406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.137436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 968/1937] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:16.139873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:16.156222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287eb0-f797-479e-beca-1ea498837571 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.163342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.165258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.165746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.166503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] PATH_INFO: `/v3/projects/1d603b1706df432a94ca7503518cce5b/users/468c4c65fca546c08bb5f041c972dbee/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.170186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d603b1706df432a94ca7503518cce5b, user_id=468c4c65fca546c08bb5f041c972dbee, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.174978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d884-3661-435d-9fde-d84d03ece547 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.183250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d3171543d74535aabae740622eb788'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.192365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 969/1938] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:16 2022] PUT /identity/v3/projects/1d603b1706df432a94ca7503518cce5b/users/468c4c65fca546c08bb5f041c972dbee/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:16.202507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.203520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.203520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.213104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d3171543d74535aabae740622eb788'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.213743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d3171543d74535aabae740622eb788'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.214458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d3171543d74535aabae740622eb788'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.227891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d3171543d74535aabae740622eb788'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.258259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] MFA Rules not processed for user `468c4c65fca546c08bb5f041c972dbee`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:16.259878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.261687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 970/1939] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:15 2022] DELETE /identity/v3/users/17d3171543d74535aabae740622eb788 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:16.316350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:16.384954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:16.387205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.437720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 970/1940] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:16.456039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:16.458982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.481830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:16.518655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6685a-9bba-40df-98fb-de0e22f8a614 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.527226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.527992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.528343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.528735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] PATH_INFO: `/v3/projects/f8f284dd9daf453a888e2a7637c6e208` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.529949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f284dd9daf453a888e2a7637c6e208)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.532064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.601227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61541d32-00c6-4e32-82ec-ac9c69d11bf6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.634783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f284dd9daf453a888e2a7637c6e208', 'request_id': 'req-48943da0-3478-4763-ab96-4eb91c057f53'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.653284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f284dd9daf453a888e2a7637c6e208', 'request_id': 'req-48943da0-3478-4763-ab96-4eb91c057f53'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.664737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f284dd9daf453a888e2a7637c6e208', 'request_id': 'req-48943da0-3478-4763-ab96-4eb91c057f53'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.687926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] The token cache is being invalidate because project f8f284dd9daf453a888e2a7637c6e208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:16.688924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.690194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.695982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 971/1941] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:16 2022] DELETE /identity/v3/projects/f8f284dd9daf453a888e2a7637c6e208 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:16.696880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:16.699658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.706132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.706882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.707259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.707630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.709510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.819261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48943da0-3478-4763-ab96-4eb91c057f53 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:16.826848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:16.828678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:16.828678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:16.828974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] PATH_INFO: `/v3/users/5a138db3617d4cf29751f9e4aec82888` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:16.831194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a138db3617d4cf29751f9e4aec82888)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.833446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.852812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:16.854305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:16.878732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 971/1942] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:16.924240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a138db3617d4cf29751f9e4aec82888'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.936241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a138db3617d4cf29751f9e4aec82888'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.938681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a138db3617d4cf29751f9e4aec82888'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.939872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a138db3617d4cf29751f9e4aec82888'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.953118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:16.955142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:16.969961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-285db003-fe85-4a50-b376-25433339c6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a138db3617d4cf29751f9e4aec82888'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:16.996846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:17.007536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 972/1943] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:16 2022] DELETE /identity/v3/users/5a138db3617d4cf29751f9e4aec82888 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:17.011277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a15df-940f-4ab7-a604-74d6db97a116 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:17.073845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:17.136858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:17.138152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.138633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.139899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] PATH_INFO: `/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.141751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06c46695fee44e49a5c6ed23e7c21ec)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:17.147362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:17.223979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06c46695fee44e49a5c6ed23e7c21ec', 'request_id': 'req-31b5f90a-5bbb-4a03-9910-15b855dbe123'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:17.232016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06c46695fee44e49a5c6ed23e7c21ec', 'request_id': 'req-31b5f90a-5bbb-4a03-9910-15b855dbe123'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:17.246037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06c46695fee44e49a5c6ed23e7c21ec', 'request_id': 'req-31b5f90a-5bbb-4a03-9910-15b855dbe123'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:17.272555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] The token cache is being invalidate because project c06c46695fee44e49a5c6ed23e7c21ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:17.273292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:17.276608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-31b5f90a-5bbb-4a03-9910-15b855dbe123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:17.282233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 972/1944] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:16 2022] DELETE /identity/v3/projects/c06c46695fee44e49a5c6ed23e7c21ec => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:17.287644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.288137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.288214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.329105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:17.330920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:17.484346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 973/1945] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:17.486228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.486531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.486789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.542956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:17.544436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:17.572627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 973/1946] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:17.574333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:17.592615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c157a02-6494-4c52-868b-db7ab5e52adf None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:17.612107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:17.616427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.616865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.617151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.619908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:17.620224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:17.624203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:17.666583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 974/1947] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:17.670998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:17.689394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43dd78-eed4-400c-9575-d5af48d530d1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:17.709530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:17.712371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.713109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.713583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.714688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:17.717510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:17.779470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 974/1948] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:17 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:17.784234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:17.801204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66251-d0c7-4bf3-8c15-08879ab51c5e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:17.903474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:17.904384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.904928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.905521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.907155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:17.911401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:17.945298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 975/1949] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:17 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:17.961885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:17.978417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d92ae-71b0-4f11-ac0b-4da26ed6b2b5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:17.987228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:17.988113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:17.988327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:17.988745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:17.990493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:17.992760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.027111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.030277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 975/1950] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:18.045877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d057-2440-40b6-8696-aef62b6e1418 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.052164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.054481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.057742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.058455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.060549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.060987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.061729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.067219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.077565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb9ae3-b770-4a8b-aebb-82185d9cc9e1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.092634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 976/1951] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:18.108228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.108897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.109249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.109422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] PATH_INFO: `/v3/projects/27ec6a19d36f40bc9c8c554477ee9034` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.113651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ec6a19d36f40bc9c8c554477ee9034)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.116442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.122689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.146183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a3d0-6ed5-43bc-a799-24b5bb6eb3b4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.156560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.157330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.158193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.158538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] PATH_INFO: `/v3/projects/39cbeb618e594d388cfbb1ad28558bb3/users/be55b0c12d96401886a0a2e949a3cbfa/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.181821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cbeb618e594d388cfbb1ad28558bb3, user_id=be55b0c12d96401886a0a2e949a3cbfa, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.184837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b79eb-e23c-44c6-a5d5-35326ae0b47f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.189704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ec6a19d36f40bc9c8c554477ee9034', 'request_id': 'req-c03ea393-181d-45ea-a448-4522ca0f0670'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.198772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ec6a19d36f40bc9c8c554477ee9034', 'request_id': 'req-c03ea393-181d-45ea-a448-4522ca0f0670'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.209410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 977/1952] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:18 2022] PUT /identity/v3/projects/39cbeb618e594d388cfbb1ad28558bb3/users/be55b0c12d96401886a0a2e949a3cbfa/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:18.223394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ec6a19d36f40bc9c8c554477ee9034', 'request_id': 'req-c03ea393-181d-45ea-a448-4522ca0f0670'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.224174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77de25-98eb-4909-8f60-9fcc217cc404 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.224524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77de25-98eb-4909-8f60-9fcc217cc404 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.224999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77de25-98eb-4909-8f60-9fcc217cc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.240264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] The token cache is being invalidate because project 27ec6a19d36f40bc9c8c554477ee9034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:18.240780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.241797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03ea393-181d-45ea-a448-4522ca0f0670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.245624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 976/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:18 2022] DELETE /identity/v3/projects/27ec6a19d36f40bc9c8c554477ee9034 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:18.252368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.252855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.253202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.269224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2a77de25-98eb-4909-8f60-9fcc217cc404 None None] MFA Rules not processed for user `be55b0c12d96401886a0a2e949a3cbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:18.270565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2a77de25-98eb-4909-8f60-9fcc217cc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.284441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:18.300431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:18.304042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.317827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:18.405479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 977/1954] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:18.405479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.408208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 978/1955] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:18.409402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.412120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.412404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.412735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.430641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169a05e-b27f-45ca-9646-f6a6abd3b3c1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.435261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:18.435569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.436227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.436502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.436654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.436802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] PATH_INFO: `/v3/users/ed6edb7f91b9441b924555b1e01f1976` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.438330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6edb7f91b9441b924555b1e01f1976)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.440282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.447079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 979/1956] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:18.447731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.449235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.462779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e86058-621c-4ccb-87f8-db0eae85f49b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.468328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.469177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.469526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.469861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.470847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.473125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.508647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 980/1957] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:18.509706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.513552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6edb7f91b9441b924555b1e01f1976'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.529246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6edb7f91b9441b924555b1e01f1976'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.531271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6edb7f91b9441b924555b1e01f1976'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.535615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6edb7f91b9441b924555b1e01f1976'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.570770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6edb7f91b9441b924555b1e01f1976'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:18.596359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6d9e-769f-4471-8113-f896a682fa20 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.600256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 978/1958] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:18 2022] DELETE /identity/v3/users/ed6edb7f91b9441b924555b1e01f1976 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:18.601464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.603255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.610199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.610923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.612554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.613559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.615680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:18.616231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.619193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46569447-9b7b-4710-91b2-ecd82159daab admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.646790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 981/1959] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:18.648210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.648502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.648836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.679811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:18.681386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.717307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669465-c765-4af2-9e43-c1541ac2390e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.737374 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.738135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.738423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.738697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.739485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.743297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.764392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 982/1960] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:18.769107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.769107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.784779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228caf4-11f7-4da3-8257-98d4691cf676 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.792451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:18.793365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:18.793745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:18.794142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:18.794932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:18.797768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:18.802330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 979/1961] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:18.802330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.805805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:18.831704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:18.844197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 983/1962] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:18 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:18.846102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:18.864714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:18.957980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f985-a6cd-4646-a21d-5df3da213367 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:18.995438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3239a2d-8f2b-4bd6-a40e-fb8c933afb9f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.059047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.061975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.063833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.064758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.065658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.067483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.080471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 984/1963] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:19.081715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.086923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.087564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.087845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.088516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.098489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0511f3-78d2-4ab3-be33-64928c179bae admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.100276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.102078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.104118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.104995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.105499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.106060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.106901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.110032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.113887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 980/1964] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:19.114732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.116197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.130078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfe5d0-ee21-45ee-8843-0883c641f631 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.135319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.135951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.136355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.136744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] PATH_INFO: `/v3/users/d97d79a0f4564b779fada6faf60a3ba0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.137809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97d79a0f4564b779fada6faf60a3ba0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.140044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.165092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 985/1965] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:19 2022] POST /identity/v3/users => generated 286 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:19.166174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.187721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4471ccf-f99d-4d89-abf9-968932d9a2a1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.211668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.213514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.215125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.216156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] PATH_INFO: `/v3/projects/620f95971ca7423db25680b1a08edf8f/users/6f74a8e9fc264e46a1372009ee7e0823/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.218124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97d79a0f4564b779fada6faf60a3ba0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.241031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97d79a0f4564b779fada6faf60a3ba0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.242313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97d79a0f4564b779fada6faf60a3ba0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.243159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97d79a0f4564b779fada6faf60a3ba0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.258171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620f95971ca7423db25680b1a08edf8f, user_id=6f74a8e9fc264e46a1372009ee7e0823, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.263897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97d79a0f4564b779fada6faf60a3ba0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.271141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba394dc-11d6-41af-b8eb-efb57803d726 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.284666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 981/1966] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:19 2022] DELETE /identity/v3/users/d97d79a0f4564b779fada6faf60a3ba0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:19.284666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.288622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.304398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 986/1967] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:19 2022] PUT /identity/v3/projects/620f95971ca7423db25680b1a08edf8f/users/6f74a8e9fc264e46a1372009ee7e0823/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:19.306576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.306873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.307151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.346860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:19.363230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:19.364659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.391472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751be1-07bb-4fe2-ae62-9d5f39c74318 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.505483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.506776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.509411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.510408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.511209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.518229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.525224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 987/1968] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:19.525224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.533363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.545102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 982/1969] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:19.549728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.554115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397a9d8-974b-43ce-8d32-74124b19fdbc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.561619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.562110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87c4ef-e17f-4856-a05f-2365f095f612 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.562395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.562741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.563138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.565845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.567489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.568321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.568662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.569004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.569796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.571550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.577803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.583122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 983/1970] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:01:19.583970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.586444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.602870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 988/1971] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:19.602870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.616190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e00880-5397-4886-a807-60a54ad324b3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.627106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.628210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.628689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.629119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] PATH_INFO: `/v3/projects/b92d76261a1f42cb8956f61f7a39ff92/users/914b572d048f4f7ca4587d97e0a42f01/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.655764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92d76261a1f42cb8956f61f7a39ff92, user_id=914b572d048f4f7ca4587d97e0a42f01, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.659451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.664366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fd49-e8e9-4f81-9acb-25e4c3a9b4d2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.668410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.669215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.669495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.669765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.681588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 989/1972] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:19 2022] PUT /identity/v3/projects/b92d76261a1f42cb8956f61f7a39ff92/users/914b572d048f4f7ca4587d97e0a42f01/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:19.682344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.682485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.684208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.684340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.705479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 984/1973] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:19.707134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.720221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d2854-84b1-4980-b384-ef43821e1e16 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.730265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:19.772943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ce06-cb19-4c66-aee1-3d2d05e3b9c2 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.780907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.781688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.782146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.784537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] PATH_INFO: `/v3/projects/01dc09e152c2464e89148b1ec645ca2a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.785942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=01dc09e152c2464e89148b1ec645ca2a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.789464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.796474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.797414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.797534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.797785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] PATH_INFO: `/v3/projects/620f95971ca7423db25680b1a08edf8f/users/6f74a8e9fc264e46a1372009ee7e0823/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.800404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=620f95971ca7423db25680b1a08edf8f, user_id=6f74a8e9fc264e46a1372009ee7e0823, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.803191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdb587-9ced-40ef-9a8f-a95b80c813ee admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:19.817186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 985/1974] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:19 2022] PUT /identity/v3/projects/620f95971ca7423db25680b1a08edf8f/users/6f74a8e9fc264e46a1372009ee7e0823/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:19.818280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.818562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.818833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.846771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:19.848161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.852528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:19.857146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01dc09e152c2464e89148b1ec645ca2a', 'request_id': 'req-b0d4b1f3-2273-4185-8030-0c36709bfeaa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.868209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01dc09e152c2464e89148b1ec645ca2a', 'request_id': 'req-b0d4b1f3-2273-4185-8030-0c36709bfeaa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.875700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01dc09e152c2464e89148b1ec645ca2a', 'request_id': 'req-b0d4b1f3-2273-4185-8030-0c36709bfeaa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.889941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] The token cache is being invalidate because project 01dc09e152c2464e89148b1ec645ca2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:19.890323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.891040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b0d4b1f3-2273-4185-8030-0c36709bfeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:19.893203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 990/1975] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:19 2022] DELETE /identity/v3/projects/01dc09e152c2464e89148b1ec645ca2a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:19.894508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.895451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.895744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.925141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 986/1976] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:19.925936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:19.927364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.936371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] MFA Rules not processed for user `6f74a8e9fc264e46a1372009ee7e0823`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:19.937832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:19.941952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9afa8-82c5-4cc0-a0ec-56a0d74ae411 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:19.947159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:19.948015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:19.948928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:19.949234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] PATH_INFO: `/v3/users/468c4c65fca546c08bb5f041c972dbee` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:19.950535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468c4c65fca546c08bb5f041c972dbee)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:19.952597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:20.018760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468c4c65fca546c08bb5f041c972dbee'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.028745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468c4c65fca546c08bb5f041c972dbee'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.029556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468c4c65fca546c08bb5f041c972dbee'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.030253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468c4c65fca546c08bb5f041c972dbee'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.039747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 991/1977] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:20.040876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:20.042457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.047965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468c4c65fca546c08bb5f041c972dbee'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.076602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 987/1978] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:19 2022] DELETE /identity/v3/users/468c4c65fca546c08bb5f041c972dbee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:20.076602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:20.077781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.122745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:20.132908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a07e-2594-4924-aaa8-bfb9a54a23e7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:20.222298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:20.222919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.223262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.223611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.225573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.229850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce220b-a114-4420-ada5-89f0df9d8a13 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:20.237390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:20.238085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.238371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.239217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.242396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.318932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:20.332020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:20.334839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:20.355905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 992/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:20.364824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:20.366688 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:20.379738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 988/1980] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:20.433260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:20.436216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.483071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d078f3-dac1-41e9-b253-d17f37e63c6e service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:20.496900 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:20.497801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.498188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.498491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.500258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.601441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:20.603591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:20.616767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 993/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:20.653050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:20.654738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.692848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fca6c-72b8-4260-abb3-74a468b5a5ae service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:20.725867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:20.727079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.729071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.729071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] PATH_INFO: `/v3/projects/1d603b1706df432a94ca7503518cce5b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.732609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d603b1706df432a94ca7503518cce5b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:20.735234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:20.863441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:20.870935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:20.871415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d603b1706df432a94ca7503518cce5b', 'request_id': 'req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.882083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d603b1706df432a94ca7503518cce5b', 'request_id': 'req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.887870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470f808-c140-403a-a77d-71868134b1cb service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:20.903765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d603b1706df432a94ca7503518cce5b', 'request_id': 'req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.958326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] The token cache is being invalidate because project 1d603b1706df432a94ca7503518cce5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:20.959259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.960939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b6c3b00-bf3e-4a6b-ad4c-d8fcbc9783b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:20.961905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:20.964956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 989/1982] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:20 2022] DELETE /identity/v3/projects/1d603b1706df432a94ca7503518cce5b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:20.971955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077236-fa1c-41c2-a18d-03419be14d85 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.972612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077236-fa1c-41c2-a18d-03419be14d85 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.973634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077236-fa1c-41c2-a18d-03419be14d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.984009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:20.984717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:20.985029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:20.986298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] PATH_INFO: `/v3/projects/777d704edec94fc4ba3e03cf3832bfe2` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:20.987878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777d704edec94fc4ba3e03cf3832bfe2)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:20.990834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:21.045257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b9077236-fa1c-41c2-a18d-03419be14d85 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:21.050020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b9077236-fa1c-41c2-a18d-03419be14d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:21.106542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777d704edec94fc4ba3e03cf3832bfe2', 'request_id': 'req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.138615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777d704edec94fc4ba3e03cf3832bfe2', 'request_id': 'req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.159251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777d704edec94fc4ba3e03cf3832bfe2', 'request_id': 'req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.208372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] The token cache is being invalidate because project 777d704edec94fc4ba3e03cf3832bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:21.208698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.212908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.227470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 994/1983] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:20 2022] DELETE /identity/v3/projects/777d704edec94fc4ba3e03cf3832bfe2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:21.228389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:21.238197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:21.322010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 990/1984] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:21.333183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.333603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.334073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.383638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:21.386870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:21.409591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 991/1985] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:21.410887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:21.448225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293f8d-726a-4927-a25d-a04b541501a1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:21.462560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:21.462756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab3ec2-84fd-427b-92aa-fe251dcc19e3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:21.463977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.463977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.471494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.472634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:21.473192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:21.477016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:21.484663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:21.485363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.492253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.492555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] PATH_INFO: `/v3/users/abdac79bfcbf4d4cb9ac34b8217f5623` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.495136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abdac79bfcbf4d4cb9ac34b8217f5623)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:21.501400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:21.503670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 992/1986] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:21.509197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:21.524454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20908fa8-d2cb-447a-8fe2-0def6e8d1f7f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:21.530402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:21.531415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.531891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.532253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.533410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:21.535885 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:21.618259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 993/1987] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:21 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:21.622434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:21.653734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abdac79bfcbf4d4cb9ac34b8217f5623'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.675634 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abdac79bfcbf4d4cb9ac34b8217f5623'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.676799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:21.676997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abdac79bfcbf4d4cb9ac34b8217f5623'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.678063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abdac79bfcbf4d4cb9ac34b8217f5623'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.691066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7ab781cc-4d4e-4a65-bf65-6581627a6446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abdac79bfcbf4d4cb9ac34b8217f5623'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:21.718741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:21.732848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 995/1988] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:21 2022] DELETE /identity/v3/users/abdac79bfcbf4d4cb9ac34b8217f5623 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:21.732848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.733594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.734001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.774168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] MFA Rules not processed for user `914b572d048f4f7ca4587d97e0a42f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:21.775526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:21.799714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679c616-665c-44ff-a2d3-2d66d02f9243 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:21.937436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:21.938114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:21.938357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:21.938988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:21.939934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:21.941932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:21.958184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 996/1989] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:21.966641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:21.968202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.000262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 994/1990] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:21 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:22.002176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.026612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.049610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca034031-aed4-4b01-811d-3baaa68ba6af admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.067909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.067909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.067909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.068347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.069315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.070930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.098122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 995/1991] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:22.099125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.111802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962efd3-1b4f-4559-afc4-6170472fde5b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.112719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b90581-8d47-4cff-8087-9f2d9203879c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.118651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.119302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.119683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.119964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.121003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.123508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.124266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.125643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.126621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.127113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.137703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 996/1992] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:22.143642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.147323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.149292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd70eb1-93c7-45c4-842e-05dd87971b9b service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.156091 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8fff2-18d2-47ab-ae47-362645ed54cf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.162883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.163634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.163972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.164254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] PATH_INFO: `/v3/projects/6d3007c2d6f5432b843a3a63adda02b8/users/6d61e2fc1beb42c4bdedf0a32fab2930/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.164978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 997/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:22.202313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3007c2d6f5432b843a3a63adda02b8, user_id=6d61e2fc1beb42c4bdedf0a32fab2930, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.211530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.240619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 997/1994] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:22 2022] PUT /identity/v3/projects/6d3007c2d6f5432b843a3a63adda02b8/users/6d61e2fc1beb42c4bdedf0a32fab2930/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:22.249819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.250031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.250317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.300718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.302794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.315704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] MFA Rules not processed for user `6d61e2fc1beb42c4bdedf0a32fab2930`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:22.318129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.470810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f149f-fe90-4622-8bfc-35552b1b1f96 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.484694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.486190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.486190 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.486699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] PATH_INFO: `/v3/projects/eb9440eaa9884e08bfe558e7ed110f61` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.489386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9440eaa9884e08bfe558e7ed110f61)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.497071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.507586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 998/1995] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:22.516119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.517781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.518705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:22.551026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:22.597285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9440eaa9884e08bfe558e7ed110f61', 'request_id': 'req-edb56159-5545-4eb9-9889-0a6960f26570'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:22.605445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9440eaa9884e08bfe558e7ed110f61', 'request_id': 'req-edb56159-5545-4eb9-9889-0a6960f26570'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:22.608403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d48245-7707-4573-ae9c-273a8ae0b7f5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.618640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9440eaa9884e08bfe558e7ed110f61', 'request_id': 'req-edb56159-5545-4eb9-9889-0a6960f26570'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:22.636747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] The token cache is being invalidate because project eb9440eaa9884e08bfe558e7ed110f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:22.636747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:22.636747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-edb56159-5545-4eb9-9889-0a6960f26570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:22.636747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 998/1996] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:22 2022] DELETE /identity/v3/projects/eb9440eaa9884e08bfe558e7ed110f61 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:22.645156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fd45-649d-484b-8024-2da41a7f098f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.645580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fd45-649d-484b-8024-2da41a7f098f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.646352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fd45-649d-484b-8024-2da41a7f098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.676373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-deb2fd45-649d-484b-8024-2da41a7f098f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:22.678254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-deb2fd45-649d-484b-8024-2da41a7f098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.705782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.706331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.706658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.706863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.709331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.796390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 999/1997] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:22.805743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.806201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.806977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.828373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.833298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:22.833616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.834509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:22.844718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1000/1998] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:22.846973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.850701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 999/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:22.856681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ebe0c-15c8-4fa6-a21e-510f80f2d4b1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.864768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.865767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.866270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.866741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.867794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:22.868317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.870556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.888630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1001/2000] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:01:22.891581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.907558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d109a7-14e3-484b-9cfa-ce0cfcc1a6ae service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:22.912348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:22.913060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:22.913343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:22.913618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:22.914274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:22.916271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:22.962904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1000/2001] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:22 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:22.964633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:22.979693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a938c-e4ca-4df5-84af-8c6018d4ba7a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:23.085650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:23.086963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.087322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.087566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.088351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:23.091146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:23.127297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1002/2002] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:22 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:23.130642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:23.148006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae316d-5511-49a3-bf5c-bc565b28c3f1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:23.157539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:23.158784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.159131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.159420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.160456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:23.163335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:23.178918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1001/2003] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:23.182723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:23.189736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:23.197056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56e18-4b1b-40c1-8593-e53f64af04ff admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:23.214261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:23.215425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.215805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.216314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.217228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:23.219024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bb36b-f3da-4f7a-9eee-6ba05f82f7b2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:23.237172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1003/2004] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:23.238148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:23.255617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491fad1-bacb-4fd4-a1da-c25ca9230268 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:23.266485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:23.267361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.267672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.268023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] PATH_INFO: `/v3/projects/789463b8c5a64c5a95336941044dec5e/users/1b837ddd6aed46e0b3cb0fe2ced4087b/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.318176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789463b8c5a64c5a95336941044dec5e, user_id=1b837ddd6aed46e0b3cb0fe2ced4087b, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:23.318176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:23.341201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1002/2005] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:23 2022] PUT /identity/v3/projects/789463b8c5a64c5a95336941044dec5e/users/1b837ddd6aed46e0b3cb0fe2ced4087b/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:23.355933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744410-27e9-42dc-a2ee-b603c30067b0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.356244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744410-27e9-42dc-a2ee-b603c30067b0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.356632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744410-27e9-42dc-a2ee-b603c30067b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.380834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6d744410-27e9-42dc-a2ee-b603c30067b0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:23.382230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d744410-27e9-42dc-a2ee-b603c30067b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:23.461272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1004/2006] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:23.472352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:23.474579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:23.525607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:23.548500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398160-c114-4d18-ba34-0164bd9fa783 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:23.553985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:23.554639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.554923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.555196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.570033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:23.571496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed738a-13a0-46dc-b251-991ff4aaaa04 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:23.583204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1003/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:23.888655 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421312d-8e72-43ef-84f6-badbe160b759 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:23.889173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421312d-8e72-43ef-84f6-badbe160b759 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:23.889371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421312d-8e72-43ef-84f6-badbe160b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:23.912929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d421312d-8e72-43ef-84f6-badbe160b759 None None] MFA Rules not processed for user `914b572d048f4f7ca4587d97e0a42f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:23.921308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d421312d-8e72-43ef-84f6-badbe160b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:23.994544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1005/2008] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:24.420896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.421178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.421605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:24.467812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] MFA Rules not processed for user `1b837ddd6aed46e0b3cb0fe2ced4087b`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:24.469117 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:24.518591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.520156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.520372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:24.556803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] MFA Rules not processed for user `6d61e2fc1beb42c4bdedf0a32fab2930`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:24.565058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:24.636062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1004/2009] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:24.643493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:24.663206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1006/2010] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:24.669319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46cfc0-671b-4ca9-9a36-5db8417b3fc9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:24.679413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:24.680365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.680820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.681226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:24.682822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:24.685295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:24.730042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1005/2011] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:24 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:24.733901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:24.745964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20999dc-3986-444b-87e9-0f17be0d04e2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:24.823647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:24.855403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:24.856413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.856722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.856987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:24.857701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:24.860148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:24.905222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1007/2012] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:24 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:24.909630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:24.924187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee938fbb-69a5-4910-ba7a-82439e842f0a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:24.932198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:24.932611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.933108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.933798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:24.934734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:24.936645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:24.949243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1006/2013] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:24.953534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:24.966312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4914-59be-4c18-8a8c-d0b7e21db893 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:24.976226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:24.977352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:24.977923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:24.978446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] PATH_INFO: `/v3/projects/1b8237ec79054ca1b87818e20b53f61c/users/d7be2946cb3e43e7afc069841c872650/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.008609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8237ec79054ca1b87818e20b53f61c, user_id=d7be2946cb3e43e7afc069841c872650, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:25.015475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:25.037286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1008/2014] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:24 2022] PUT /identity/v3/projects/1b8237ec79054ca1b87818e20b53f61c/users/d7be2946cb3e43e7afc069841c872650/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:25.041951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:25.056885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfb090-3616-4485-8944-77ea801736f3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:25.167766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:25.168381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:25.168733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:25.169194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.170302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:25.173821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:25.194901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:25.203330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1007/2015] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:25.207800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34dddb-8e04-4d02-a074-d0d667b5e70b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:25.222476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:25.224512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:25.230078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:25.230368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] PATH_INFO: `/v3/projects/1b8237ec79054ca1b87818e20b53f61c/users/d7be2946cb3e43e7afc069841c872650/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.236436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8237ec79054ca1b87818e20b53f61c, user_id=d7be2946cb3e43e7afc069841c872650, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:25.239484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de617-da80-4498-9be0-f5bb7376c3e2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:25.258128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1009/2016] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:25 2022] PUT /identity/v3/projects/1b8237ec79054ca1b87818e20b53f61c/users/d7be2946cb3e43e7afc069841c872650/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:25.417884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:25.419654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:25.435044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ae0a-e65a-4cbf-a962-b9c724bee100 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:25.475375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:25.516529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:25.518102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:25.518493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:25.518835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] PATH_INFO: `/v3/users/be55b0c12d96401886a0a2e949a3cbfa` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.520450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=be55b0c12d96401886a0a2e949a3cbfa)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:25.523380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:25.599343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be55b0c12d96401886a0a2e949a3cbfa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:25.609372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be55b0c12d96401886a0a2e949a3cbfa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:25.610681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be55b0c12d96401886a0a2e949a3cbfa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:25.611320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be55b0c12d96401886a0a2e949a3cbfa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:25.620964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be55b0c12d96401886a0a2e949a3cbfa'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:25.651143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1008/2017] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:25 2022] DELETE /identity/v3/users/be55b0c12d96401886a0a2e949a3cbfa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:25.655119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d4e5-a920-42b9-b61c-d967d714d38d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:25.655401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d4e5-a920-42b9-b61c-d967d714d38d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:25.655667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4d4e5-a920-42b9-b61c-d967d714d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.683108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-52e4d4e5-a920-42b9-b61c-d967d714d38d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:25.685770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52e4d4e5-a920-42b9-b61c-d967d714d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:25.822252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1010/2018] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:25.855396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:25.857715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:25.978580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3de6-f30d-4076-a6fc-ecf4464e73ce admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:25.982683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:25.983505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:25.983893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:25.984260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:25.997348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:25.999347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:26.013544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1009/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:26.768617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:26.769129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:26.769309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:26.795113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:26.795843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:26.816147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8015ee1-571e-4251-9d27-16fb687bedea service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:26.818529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] MFA Rules not processed for user `d7be2946cb3e43e7afc069841c872650`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:26.820293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:26.820984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:26.821618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:26.821903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:26.822179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] PATH_INFO: `/v3/projects/39cbeb618e594d388cfbb1ad28558bb3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:26.823305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cbeb618e594d388cfbb1ad28558bb3)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:26.825272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:26.881627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:26.883100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cbeb618e594d388cfbb1ad28558bb3', 'request_id': 'req-9b48834c-097d-41a9-bbb5-38f691ee8919'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:26.897590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cbeb618e594d388cfbb1ad28558bb3', 'request_id': 'req-9b48834c-097d-41a9-bbb5-38f691ee8919'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:26.904068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cbeb618e594d388cfbb1ad28558bb3', 'request_id': 'req-9b48834c-097d-41a9-bbb5-38f691ee8919'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:26.916270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1011/2020] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:26.918909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] The token cache is being invalidate because project 39cbeb618e594d388cfbb1ad28558bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:26.919413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:26.920244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9b48834c-097d-41a9-bbb5-38f691ee8919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:26.922054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1010/2021] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:26 2022] DELETE /identity/v3/projects/39cbeb618e594d388cfbb1ad28558bb3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:26.928341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:26.930160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:26.930579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:26.930859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:26.937151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92e605-eef4-4673-9d31-f5708b19dbb1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:26.957626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:26.958622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] MFA Rules not processed for user `1b837ddd6aed46e0b3cb0fe2ced4087b`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:26.960032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:26.998267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:26.998906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:26.999188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:26.999464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] PATH_INFO: `/v3/users/6f74a8e9fc264e46a1372009ee7e0823` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.000662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f74a8e9fc264e46a1372009ee7e0823)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:27.003218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:27.016428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1011/2022] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:27.029192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:27.030563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:27.062144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f74a8e9fc264e46a1372009ee7e0823'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.070399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f74a8e9fc264e46a1372009ee7e0823'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.071089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f74a8e9fc264e46a1372009ee7e0823'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.071875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f74a8e9fc264e46a1372009ee7e0823'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.087947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f74a8e9fc264e46a1372009ee7e0823'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.107794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1012/2023] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:26 2022] DELETE /identity/v3/users/6f74a8e9fc264e46a1372009ee7e0823 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:27.123613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c7540-79f2-46fd-acc6-7bc0c063e8e1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:27.199372 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:27.200692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.200971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.201236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.203000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:27.217710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:27.264840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:27.266467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e445-8c7e-4fc1-ac4c-fbbe71194e56 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:27.276495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1012/2024] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:27.505513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:27.506949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:27.596407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d8410-443b-4d1b-9757-0cba27ecf8b3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:27.603971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:27.604920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.605149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.605418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] PATH_INFO: `/v3/projects/620f95971ca7423db25680b1a08edf8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.606700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620f95971ca7423db25680b1a08edf8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:27.608758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:27.656416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:27.663951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620f95971ca7423db25680b1a08edf8f', 'request_id': 'req-2ccfa328-1746-4af0-bfbb-573f5aa587b2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.673841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620f95971ca7423db25680b1a08edf8f', 'request_id': 'req-2ccfa328-1746-4af0-bfbb-573f5aa587b2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.683638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620f95971ca7423db25680b1a08edf8f', 'request_id': 'req-2ccfa328-1746-4af0-bfbb-573f5aa587b2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.698888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] The token cache is being invalidate because project 620f95971ca7423db25680b1a08edf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:27.699305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.700108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ccfa328-1746-4af0-bfbb-573f5aa587b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:27.705154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1013/2025] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:27 2022] DELETE /identity/v3/projects/620f95971ca7423db25680b1a08edf8f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:27.706885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.707173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.707448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.729165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:27.730466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:27.812592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1013/2026] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:27.821436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.821906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.822160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.845409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:27.846792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:27.858539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1014/2027] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:27.860100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:27.870835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e88d08-e567-44c3-b2f9-6a3e19e939ed None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:27.875799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:27.877254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.877540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.877814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.878503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:27.878810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:27.880569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:27.895125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1014/2028] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:27.899393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:27.919550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69941f66-cca0-4de3-a6a6-d9aa93ee7282 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:27.919550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:27.919550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:27.919550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:27.919852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:27.919852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:27.920750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:27.957188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1015/2029] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:27 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:27.958196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:27.983302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c23ce-2c7c-498b-b187-b6e807b6ba5b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.071325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.071937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.072227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.072482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.073151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.075054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.101018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1015/2030] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:27 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:28.105759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.117301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84029c-cc6c-48b4-8645-f5fae750deda admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.123087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.123768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.124073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.124347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.125101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.127370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.138892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1016/2031] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:28.143255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.156515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4602ee1-e848-4ad4-a596-0705a3cdda33 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.162030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.162731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.163071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.163407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.164121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.165759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296194-3c90-4fb4-86a0-226d462a2644 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.177388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1016/2032] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:28.182501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.193309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f811b2-37ce-4260-b71b-9be7a4fb1afc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.198131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.198798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.199078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.199351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] PATH_INFO: `/v3/projects/5c8f4f9692da4bb7b59f877b0551555c/users/5c158f72befb4698b3530dd1cab6ea7d/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.217040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8f4f9692da4bb7b59f877b0551555c, user_id=5c158f72befb4698b3530dd1cab6ea7d, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.220052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.249135 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1017/2033] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:28 2022] PUT /identity/v3/projects/5c8f4f9692da4bb7b59f877b0551555c/users/5c158f72befb4698b3530dd1cab6ea7d/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:28.260560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.261012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.261414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.296894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] MFA Rules not processed for user `5c158f72befb4698b3530dd1cab6ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:28.298643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:28.309103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:28.374617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1017/2034] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:28.380409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.447952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25401ef9-079f-4f71-8d62-73cef50b1995 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.452512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.453158 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.453439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.453714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.454461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.456499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.483709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1018/2035] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:28 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:28.488807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.499331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e2ba3-ccef-4ff9-9d13-e4f4f4cd4fef None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.554758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.555357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.555631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.555901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.556521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.558558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.580347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1018/2036] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:28 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:28.584319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.595831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046976f5-dcf8-4f43-b69a-32151fafb87e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.600443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.601076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.601352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.601621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.602264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.603845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.615002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1019/2037] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:28.618997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.629616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb5d9-d42c-43d2-9076-26c382193fd6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.634409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.635083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.635338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.635608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] PATH_INFO: `/v3/projects/48db974653004360808d9aebaaf8dcb8/users/2aa89340aec1477c8b80fd9721c643ba/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.652532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48db974653004360808d9aebaaf8dcb8, user_id=2aa89340aec1477c8b80fd9721c643ba, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.655179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.670404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1019/2038] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:28 2022] PUT /identity/v3/projects/48db974653004360808d9aebaaf8dcb8/users/2aa89340aec1477c8b80fd9721c643ba/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:28.674979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.687704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94f971-85ff-4077-916d-a5b0c8694398 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.730311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:28.749584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.750290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.750568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.750994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.751635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.753273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d22b2-ce40-4afa-8f3b-d8ba6f1ca9c9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.763806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1020/2039] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:28.769014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.779022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618db64-e0f3-4c00-b622-ccb34e45ba07 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:28.784336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:28.785054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.785295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.785561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] PATH_INFO: `/v3/projects/48db974653004360808d9aebaaf8dcb8/users/2aa89340aec1477c8b80fd9721c643ba/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.787459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=48db974653004360808d9aebaaf8dcb8, user_id=2aa89340aec1477c8b80fd9721c643ba, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:28.790092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:28.809725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1020/2040] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:28 2022] PUT /identity/v3/projects/48db974653004360808d9aebaaf8dcb8/users/2aa89340aec1477c8b80fd9721c643ba/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:28.820858 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:28.821148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:28.821421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:28.868004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] MFA Rules not processed for user `2aa89340aec1477c8b80fd9721c643ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:28.870103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:28.972372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1021/2041] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:28.986546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:28.988704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:29.065274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaead3-4ec3-4b32-9ac4-1d511d885aed admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:29.081178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:29.081817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:29.082116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:29.082392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:29.093934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:29.095716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ebf65-c3dc-4d6b-b362-1c1212cba217 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:29.107216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1021/2042] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:29.145165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:29.302478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131922a-4c69-46a8-aaee-04e4d3785edd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:29.308267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:29.308961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:29.309211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:29.309480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] PATH_INFO: `/v3/users/5c158f72befb4698b3530dd1cab6ea7d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:29.310829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c158f72befb4698b3530dd1cab6ea7d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:29.312957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:29.382120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c158f72befb4698b3530dd1cab6ea7d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:29.403876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c158f72befb4698b3530dd1cab6ea7d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:29.406756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c158f72befb4698b3530dd1cab6ea7d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:29.408882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c158f72befb4698b3530dd1cab6ea7d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:29.430499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:29.436370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c158f72befb4698b3530dd1cab6ea7d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:29.461316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1022/2043] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:29 2022] DELETE /identity/v3/users/5c158f72befb4698b3530dd1cab6ea7d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:29.465518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:29.465801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:29.466074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:29.479897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:29.487220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:29.489177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:29.601376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1022/2044] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:29.611136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:29.613556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:29.700494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d0bcc-44c2-4bef-b0c1-615344702799 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:29.705393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:29.706072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:29.706350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:29.706641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:29.718290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:29.719956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:29.732142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1023/2045] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:30.653472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:30.655172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:30.670148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc3f0-c6e3-41a4-b85f-ef0c06776941 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:30.676366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:30.677288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:30.677742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:30.678791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] PATH_INFO: `/v3/projects/5c8f4f9692da4bb7b59f877b0551555c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:30.682426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8f4f9692da4bb7b59f877b0551555c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:30.684355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:30.760211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8f4f9692da4bb7b59f877b0551555c', 'request_id': 'req-8cfffc70-9540-47e6-8c08-cc3c786c01bc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.768901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8f4f9692da4bb7b59f877b0551555c', 'request_id': 'req-8cfffc70-9540-47e6-8c08-cc3c786c01bc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.775448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8f4f9692da4bb7b59f877b0551555c', 'request_id': 'req-8cfffc70-9540-47e6-8c08-cc3c786c01bc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.788222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] The token cache is being invalidate because project 5c8f4f9692da4bb7b59f877b0551555c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:30.788618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.789738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.791023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1023/2046] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:30 2022] DELETE /identity/v3/projects/5c8f4f9692da4bb7b59f877b0551555c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:30.794845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:30.806020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4e3e-f841-4503-8709-434191dfe431 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:30.894031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:30.894845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:30.895133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:30.895432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] PATH_INFO: `/v3/users/2aa89340aec1477c8b80fd9721c643ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:30.897010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa89340aec1477c8b80fd9721c643ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:30.899330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:30.972905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa89340aec1477c8b80fd9721c643ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.984360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa89340aec1477c8b80fd9721c643ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.985151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa89340aec1477c8b80fd9721c643ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:30.986014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa89340aec1477c8b80fd9721c643ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:31.000730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0fa04c47-b48f-4750-a482-25bcba7b5588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa89340aec1477c8b80fd9721c643ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:31.033916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1024/2047] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:30 2022] DELETE /identity/v3/users/2aa89340aec1477c8b80fd9721c643ba => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:31.803082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:31.804769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:31.818109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffc70-9540-47e6-8c08-cc3c786c01bc admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:31.898886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:31.899600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:31.899885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:31.900154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] PATH_INFO: `/v3/projects/48db974653004360808d9aebaaf8dcb8` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:31.901393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48db974653004360808d9aebaaf8dcb8)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:31.903790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:31.959184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:31.999055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48db974653004360808d9aebaaf8dcb8', 'request_id': 'req-85003b2c-4bfa-418e-b050-0d1a8a234896'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:32.011609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48db974653004360808d9aebaaf8dcb8', 'request_id': 'req-85003b2c-4bfa-418e-b050-0d1a8a234896'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:32.026429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48db974653004360808d9aebaaf8dcb8', 'request_id': 'req-85003b2c-4bfa-418e-b050-0d1a8a234896'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:32.068158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] The token cache is being invalidate because project 48db974653004360808d9aebaaf8dcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:32.083227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:32.083227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-85003b2c-4bfa-418e-b050-0d1a8a234896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:32.083227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1024/2048] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:31 2022] DELETE /identity/v3/projects/48db974653004360808d9aebaaf8dcb8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:32.087853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.088371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.092210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.111324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:32.130567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:32.131984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:32.237457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1025/2049] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:32.244925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.245208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.245446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.282864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:32.284148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:32.293255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1025/2050] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:32.299015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.317363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b125-718f-4a04-93e7-99f1024721c8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.323699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.325395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.325685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.325970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.339811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:32.340174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.344565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.369660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1026/2051] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:01:32.373630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.384901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3090ba3-a6ba-46c3-9027-a1ae96a64cd2 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.390381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.391022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.391282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.391787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.392514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.394680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.468928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1026/2052] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:32 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:32.473486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.483852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8503a-df13-4f79-a2ae-c305a1f72ed1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.570559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.571191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.571487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.571753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.572421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.577033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.609436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1027/2053] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:32 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:32.617170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.637315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a524d-62c1-4626-8daa-6ebcefde27a6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.644611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.645392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.645916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.646265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.647866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.649908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.663819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1027/2054] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:32.668594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.686155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c2732-5f3e-485c-817e-099bcd684c04 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.693838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.694571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.695416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.695795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.696656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.699025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5945f-bd28-42ab-b8f1-c11b491f76d6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.714678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1028/2055] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:32.718870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.730088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb26b7-d358-44b2-a789-e40b8e115fe3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:32.736114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:32.736955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.737234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.737507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] PATH_INFO: `/v3/projects/690b16fcca934b5686fc6a83a6c1a8c4/users/bb2619a8bf8a4bff94d1bffe85b363e4/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.757946 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=690b16fcca934b5686fc6a83a6c1a8c4, user_id=bb2619a8bf8a4bff94d1bffe85b363e4, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:32.761184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:32.783374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1028/2056] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:32 2022] PUT /identity/v3/projects/690b16fcca934b5686fc6a83a6c1a8c4/users/bb2619a8bf8a4bff94d1bffe85b363e4/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:32.794528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa578ae-8df0-4627-b696-2518cebfb446 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:32.795718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa578ae-8df0-4627-b696-2518cebfb446 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:32.796106 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa578ae-8df0-4627-b696-2518cebfb446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:32.841412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-caa578ae-8df0-4627-b696-2518cebfb446 None None] MFA Rules not processed for user `bb2619a8bf8a4bff94d1bffe85b363e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:32.842681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-caa578ae-8df0-4627-b696-2518cebfb446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:32.937679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:32.953876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1029/2057] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:32.968508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:32.970711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:33.129281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dce9c0-1f32-40f6-99e4-963678cfa02d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:33.133537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:33.134341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:33.134763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:33.135438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:33.146056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:33.147929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad408b61-b079-4ac6-a953-6d350501ae32 service glance] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:33.169453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1029/2058] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:41.294053 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:41.294602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:41.294683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:41.296230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1030/2059] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:01:41.312026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:41.312636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:41.312728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:41.337008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:41.338246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:41.373950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:41.405065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:41.407813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1030/2060] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:01:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:41.408607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:41.437581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:41.441450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:41.460358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377ae6-779e-4021-a3fc-051f24bd1f2e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:41.466769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:41.467388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:41.467667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:41.467938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:41.478653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:41.480384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:41.486761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deafee6-7a93-4e48-acf5-6e70951d7767 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:41.491773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:41.491984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1031/2061] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:41.492500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:41.492875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:41.493215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] PATH_INFO: `/v3/users/0ee62cef279e4a95bd9661306c319b52` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:41.494444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee62cef279e4a95bd9661306c319b52)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:41.496375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:41.551322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee62cef279e4a95bd9661306c319b52'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.562406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee62cef279e4a95bd9661306c319b52'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.563048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee62cef279e4a95bd9661306c319b52'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.563750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee62cef279e4a95bd9661306c319b52'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.576311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-987fddf7-3d51-4eee-aedd-96dea1dc13cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee62cef279e4a95bd9661306c319b52'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.589100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1031/2062] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:41 2022] DELETE /identity/v3/users/0ee62cef279e4a95bd9661306c319b52 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:41.833568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:41.850444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f83e9-4a24-430c-b5ef-dae853d22267 service placement] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:41.914710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:41.915347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:41.915629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:41.915901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] PATH_INFO: `/v3/projects/8573b9b8cea74fc787116a99b12f81e0` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:41.917062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8573b9b8cea74fc787116a99b12f81e0)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:41.919028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:41.971848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8573b9b8cea74fc787116a99b12f81e0', 'request_id': 'req-aad43014-95b7-4ae5-90d1-95a69b7c8413'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.980400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8573b9b8cea74fc787116a99b12f81e0', 'request_id': 'req-aad43014-95b7-4ae5-90d1-95a69b7c8413'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:41.986657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8573b9b8cea74fc787116a99b12f81e0', 'request_id': 'req-aad43014-95b7-4ae5-90d1-95a69b7c8413'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:42.006108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] The token cache is being invalidate because project 8573b9b8cea74fc787116a99b12f81e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:42.006783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:42.007151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-aad43014-95b7-4ae5-90d1-95a69b7c8413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:42.016472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1032/2063] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:41 2022] DELETE /identity/v3/projects/8573b9b8cea74fc787116a99b12f81e0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:42.024850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.025203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.025475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.046268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:42.047569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:42.112211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1032/2064] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:42.120028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.120315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.120720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.141588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:42.143656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:42.152189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1033/2065] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:42.156224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.168304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c1e88-7fb0-419e-9e13-692db764c109 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.173535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.174319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.174606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.174876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.175527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:42.175914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.177471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.192681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1033/2066] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:42.196384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.206090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54ddf2-46b8-4595-a1d3-e5cb7baa96dc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.210771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.211369 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.211650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.211919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.212556 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.214682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.250269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1034/2067] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:42 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:42.255825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.265950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624e-c234-4c94-8d3e-b2d7791efde8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.270325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:42.346434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.347536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.347820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.348149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.349353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.351324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.378702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1034/2068] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:42 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:42.380005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.390554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f513-5fea-4cc7-a807-4e27d389f1d4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.395399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.396107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.396474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.396832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.397627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.399308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.409730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1035/2069] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:42.414204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.425636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa74cfd-6bdd-4884-ac77-0169d5b46bef admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.430827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.431494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.431841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.432196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.432986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.434983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0549-b3cf-4e68-9b29-5909eb36e2d9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.450517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1035/2070] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:42.452326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.465406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a380a4-9bad-4de1-b4ee-79467dd8a85f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.474488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.475203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.475479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.475780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] PATH_INFO: `/v3/projects/8525df9d901444bb9eebcffa32289367/users/c182ddfcfa5a414ebfc09c0471b33d54/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.488994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:42.493823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8525df9d901444bb9eebcffa32289367, user_id=c182ddfcfa5a414ebfc09c0471b33d54, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.496760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.512790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1036/2071] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:42 2022] PUT /identity/v3/projects/8525df9d901444bb9eebcffa32289367/users/c182ddfcfa5a414ebfc09c0471b33d54/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:42.523185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.528509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.528916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.562669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] MFA Rules not processed for user `c182ddfcfa5a414ebfc09c0471b33d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:42.564569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:42.645040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1036/2072] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:42.659370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:42.661277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:42.746458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618aee-e500-4a68-82bf-944e43a92130 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:42.752525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:42.753152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:42.753425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:42.753691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:42.761445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:42.763092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5496b-15f5-405a-ad29-9ca7faab5c76 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:42.773780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1037/2073] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:45.793825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:45.867442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f54a-54d1-437d-99bc-c98d3cd2c3d4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:45.873232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:45.874014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:45.874503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:45.874778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] PATH_INFO: `/v3/users/c182ddfcfa5a414ebfc09c0471b33d54` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:45.875914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c182ddfcfa5a414ebfc09c0471b33d54)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:45.878151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:45.895964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:45.928838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c182ddfcfa5a414ebfc09c0471b33d54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:45.935934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c182ddfcfa5a414ebfc09c0471b33d54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:45.936556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c182ddfcfa5a414ebfc09c0471b33d54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:45.937218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c182ddfcfa5a414ebfc09c0471b33d54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:45.949931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c182ddfcfa5a414ebfc09c0471b33d54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:45.963074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1037/2074] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:45 2022] DELETE /identity/v3/users/c182ddfcfa5a414ebfc09c0471b33d54 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:45.967551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:45.967994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:45.968221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:45.988032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:45.989381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:46.048370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1038/2075] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:46.060048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:46.061599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:46.118679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af304-9841-4872-b021-f2145f935f16 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:46.122375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:46.122974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:46.123250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:46.123516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:46.137480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:46.138921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156e41-88ad-4b9f-b24f-910243cbf24c service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:46.149004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1038/2076] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:46.738515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:46.740259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:46.755306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b93ab-f9a0-41fc-b88c-f9b8c83e33be None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:46.760016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:46.760784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:46.761141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:46.761616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] PATH_INFO: `/v3/projects/8525df9d901444bb9eebcffa32289367` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:46.764406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8525df9d901444bb9eebcffa32289367)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:46.766764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:46.822577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8525df9d901444bb9eebcffa32289367', 'request_id': 'req-41e255bc-9e91-4134-862a-8d9ebd1828bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:46.830500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8525df9d901444bb9eebcffa32289367', 'request_id': 'req-41e255bc-9e91-4134-862a-8d9ebd1828bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:46.840848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8525df9d901444bb9eebcffa32289367', 'request_id': 'req-41e255bc-9e91-4134-862a-8d9ebd1828bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:46.848527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:46.854174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] The token cache is being invalidate because project 8525df9d901444bb9eebcffa32289367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:46.854827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:46.855669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-41e255bc-9e91-4134-862a-8d9ebd1828bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:46.857732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1039/2077] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:46 2022] DELETE /identity/v3/projects/8525df9d901444bb9eebcffa32289367 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:46.863224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:46.863699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:46.863807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:46.884123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:46.885374 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:46.973466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1039/2078] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:46.984119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:46.984653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:46.984748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.005625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:47.006760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:47.020844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1040/2079] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:47.025151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.036276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295573-b46a-42ee-bd55-736ac4e8a597 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.047304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.047927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.048392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.048709 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.049371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:47.049738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.051675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.064390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1040/2080] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:47.069426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.078446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6eb75b-51ad-4c7d-af6f-e5f8f9a9f27b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.083859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.084451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.084760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.085031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.085685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.087573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.118588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1041/2081] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:47.119953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.131668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e77cc-1eec-456a-bf0b-518958819f88 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.154818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:47.195661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.196302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.196600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.196875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.197507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.199427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.224249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1041/2082] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:47.225573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.235973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019e166-be7d-4e5b-b431-e9f8e09f9b8f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.243602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.247139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.247139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.247139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.247139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.249921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.274451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1042/2083] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:01:47.278741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.291671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dabf89-eec6-4e2a-a5d5-27d9f4a61c3f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.296316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.296953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.297231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.297502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.298143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.299798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a382-9449-40ea-a751-cf59be8ef23b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.311580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1042/2084] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:47.315979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.326407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1f40-2228-41d0-83df-25229e36a3df admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.331922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.332680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.332960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.333231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] PATH_INFO: `/v3/projects/a9ab17310ea34f85889312a54dba083e/users/2d14fa9514704c598657d6ee4ec79df0/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.347391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ab17310ea34f85889312a54dba083e, user_id=2d14fa9514704c598657d6ee4ec79df0, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.350124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.364058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1043/2085] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:47 2022] PUT /identity/v3/projects/a9ab17310ea34f85889312a54dba083e/users/2d14fa9514704c598657d6ee4ec79df0/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:47.374334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.374628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.374897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.403063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] MFA Rules not processed for user `2d14fa9514704c598657d6ee4ec79df0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:47.404306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:47.471588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1043/2086] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:47.476167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.541413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6577-d648-4fc9-89bb-5b632aa2240f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.545953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.546548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.546824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.547089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.547707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.549752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.575509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1044/2087] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:47.579650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.591249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa52e7-3707-4480-acc6-821c0137f975 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.651692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.652311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.652594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.652864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.653482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.655387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.676581 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1044/2088] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:47.680974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.691464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191d81-35e1-4085-a43f-5c3bf86195a2 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.696535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.697222 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.697502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.697780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.698630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.700253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.711636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1045/2089] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:47.715896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.727051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702fae3-5265-4e6a-bb35-f610a908c013 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.731659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.732288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.732568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.732874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.733544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.735184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77265cbf-16d5-497d-95c4-1d34c7cb1d61 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.745756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1045/2090] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:47.750295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:47.760882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c2ca2-ff08-4d43-9cbc-88e9c9c44a4e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:47.767561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:47.769932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.769932 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.774826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] PATH_INFO: `/v3/projects/18fddac5eaf74d0bb1a61fb41c8c0ec3/users/1d43ae94be97449581b207080642a670/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.790603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fddac5eaf74d0bb1a61fb41c8c0ec3, user_id=1d43ae94be97449581b207080642a670, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:47.793480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:47.809390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1046/2091] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:47 2022] PUT /identity/v3/projects/18fddac5eaf74d0bb1a61fb41c8c0ec3/users/1d43ae94be97449581b207080642a670/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:47.820497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:47.820821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:47.821099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:47.843857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:47.855682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] MFA Rules not processed for user `1d43ae94be97449581b207080642a670`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:47.857385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:47.944679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1046/2092] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:47.957880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.030253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:48.049901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85377-ae0b-40d0-8420-b215f89da8f5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.054777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.055387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.055706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.055988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.056782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.058692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.098995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1047/2093] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:48.104136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.124050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845bc30-f962-40d3-b3d9-26ff871309f6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.216061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.216903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.217325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.217964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.218786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.222663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.253256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1047/2094] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:48 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:48.257599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.275555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bf73-9b87-4220-b1b1-105c26c7292a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.282162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.283284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.283824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.291544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.292388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.294022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.318235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1048/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:48.322547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.333633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a65d-aeae-42bc-b2f6-a0f22187fb82 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.339134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.339663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.339937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.340519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] PATH_INFO: `/v3/projects/edd13e577ffa449ba2af1b24e45c4897/users/e2db5e0113ce4013afab4cec8505b04c/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.357023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd13e577ffa449ba2af1b24e45c4897, user_id=e2db5e0113ce4013afab4cec8505b04c, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.359733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.373215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1048/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:48 2022] PUT /identity/v3/projects/edd13e577ffa449ba2af1b24e45c4897/users/e2db5e0113ce4013afab4cec8505b04c/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:48.377352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.387927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a796d-b846-4e57-80d6-aff495521fe0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.454643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.455288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.455610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.455882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.456533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.458282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9a1a6-72ae-41e5-9ef4-ab2770852056 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.472305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1049/2097] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:48.473667 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.489490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079459f4-abc5-493b-b991-c9601a050142 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.495206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.495875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.496149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.496419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] PATH_INFO: `/v3/projects/edd13e577ffa449ba2af1b24e45c4897/users/e2db5e0113ce4013afab4cec8505b04c/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.499085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd13e577ffa449ba2af1b24e45c4897, user_id=e2db5e0113ce4013afab4cec8505b04c, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.502285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.538463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1049/2098] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:48 2022] PUT /identity/v3/projects/edd13e577ffa449ba2af1b24e45c4897/users/e2db5e0113ce4013afab4cec8505b04c/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:48.540744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.541094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.541379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.574818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] MFA Rules not processed for user `e2db5e0113ce4013afab4cec8505b04c`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:48.576054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:48.678981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1050/2099] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:48.698565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:48.701763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:48.779243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965ff0-25f3-40d5-adaf-890569d110d4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:48.783055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:48.783660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:48.784532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:48.784896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:48.791957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:48.794616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:48.796698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:48.807560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1050/2100] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:49.342762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:49.344148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:49.356843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01f958-288c-4971-9be3-3d42db24e89b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:49.360378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:49.361007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:49.361282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:49.361551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:49.403010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:49.431040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:49.432565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:49.442507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1051/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:53.555251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:53.567363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa724-eba3-4378-9506-0e9b15a4552a service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:53.583907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:53.584523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:53.584848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:53.585086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:53.590543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:53.601761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95374bd-8039-4333-905f-564f937ac518 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:53.605480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:53.606266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:53.606543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:53.606809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:53.609067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:53.697699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:53.699613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dd20-2ffc-42f6-bc94-1f7b22418138 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:53.703189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:53.705025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:53.716053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1052/2102] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:53.717187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1051/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:54.334604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:54.336021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:54.414885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9972-1ae5-49c1-b211-f67c62217e2c service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:54.420338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:54.421159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:54.421450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:54.422315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] PATH_INFO: `/v3/users/bb2619a8bf8a4bff94d1bffe85b363e4` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:54.423751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2619a8bf8a4bff94d1bffe85b363e4)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:54.426492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:54.493508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2619a8bf8a4bff94d1bffe85b363e4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:54.503814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2619a8bf8a4bff94d1bffe85b363e4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:54.504533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2619a8bf8a4bff94d1bffe85b363e4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:54.505228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2619a8bf8a4bff94d1bffe85b363e4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:54.514667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2619a8bf8a4bff94d1bffe85b363e4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:54.526056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:54.539680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1053/2104] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:54 2022] DELETE /identity/v3/users/bb2619a8bf8a4bff94d1bffe85b363e4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:54.545677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a3aa-b7aa-435d-b159-09798886470f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:54.546657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a3aa-b7aa-435d-b159-09798886470f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:54.547233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52a3aa-b7aa-435d-b159-09798886470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:54.570103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9c52a3aa-b7aa-435d-b159-09798886470f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:54.571611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9c52a3aa-b7aa-435d-b159-09798886470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:54.641316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1052/2105] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:54.651038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:54.653017 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:54.717353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e567a-0076-44fb-b569-155d2b06de05 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:54.722236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:54.722984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:54.723768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:54.723768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:54.734960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:54.736047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:54.747290 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1054/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:55.118280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.118676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.119284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.142272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:55.143506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.149240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.150908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.167489 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf9f35-dd75-428b-81fb-f8b085cfbd88 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.175657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.176242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.177180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.177616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] PATH_INFO: `/v3/projects/690b16fcca934b5686fc6a83a6c1a8c4` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.179506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=690b16fcca934b5686fc6a83a6c1a8c4)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.182044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.204958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1053/2107] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:55.231894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690b16fcca934b5686fc6a83a6c1a8c4', 'request_id': 'req-ecf5c279-902f-4de9-92c8-c92bf3628cfe'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:55.241305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690b16fcca934b5686fc6a83a6c1a8c4', 'request_id': 'req-ecf5c279-902f-4de9-92c8-c92bf3628cfe'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:55.247696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690b16fcca934b5686fc6a83a6c1a8c4', 'request_id': 'req-ecf5c279-902f-4de9-92c8-c92bf3628cfe'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:55.250600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.252018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.260357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] The token cache is being invalidate because project 690b16fcca934b5686fc6a83a6c1a8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:55.260765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:55.261445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ecf5c279-902f-4de9-92c8-c92bf3628cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:55.262968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1055/2108] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:55 2022] DELETE /identity/v3/projects/690b16fcca934b5686fc6a83a6c1a8c4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:55.267723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d862-a92f-48eb-b4bf-c2177dbed86c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.268250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d862-a92f-48eb-b4bf-c2177dbed86c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.268642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d862-a92f-48eb-b4bf-c2177dbed86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.287759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b169d862-a92f-48eb-b4bf-c2177dbed86c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:55.289104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b169d862-a92f-48eb-b4bf-c2177dbed86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.298109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:55.327846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b8f9-ede5-4ee8-bf7f-e9aa673b4d13 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.351491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1056/2109] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:55.360096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.360376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.360678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.380356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:55.381581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.388212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.388863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.389143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.389331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1057/2110] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:55.389431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.391259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.393561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.402716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce646ec-37c9-4c02-85e0-dc4ca967f7c8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.407351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.407924 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.408209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.408465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.409670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:55.410021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.411592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.418141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:55.427479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1058/2111] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:01:55.430582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.442628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5409f8-3dcd-4531-9f5b-cd5bc8af2e4a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.447621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.448208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.448483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.448780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.449410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.451327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.453914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.455738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.464397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1054/2112] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 07:01:55.479639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1059/2113] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:55.483676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.494852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459373c-cb34-47c3-8e3f-96ff052051d1 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.559562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.560225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.560505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.560810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.561454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.563475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.587197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1055/2114] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:55.591209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.602194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc33af-444f-4121-a2d8-458d07ac1e41 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.606855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.607437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.607921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.608196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.609611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.611212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.625001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1060/2115] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:55.629996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.641204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64467-9428-4d99-bac0-720fd86f8164 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.653097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.653719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.653995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.654316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.655580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.657597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc275d-1cc1-4ffa-a48f-2394038fbfe4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.669873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1056/2116] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:55.674539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:55.686314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe2b8a-7335-4df3-94ad-a7d415ce6cf3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:55.698540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:55.699283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.699631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.701171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] PATH_INFO: `/v3/projects/41d40c8f538d4a679f57c3bfd386cb49/users/18c9530da2894230ad525278c63ccbb9/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.718303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d40c8f538d4a679f57c3bfd386cb49, user_id=18c9530da2894230ad525278c63ccbb9, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:55.721374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:55.738839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1061/2117] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:55 2022] PUT /identity/v3/projects/41d40c8f538d4a679f57c3bfd386cb49/users/18c9530da2894230ad525278c63ccbb9/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:55.749017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:55.749302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:55.749598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:55.758324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:55.796010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] MFA Rules not processed for user `18c9530da2894230ad525278c63ccbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:55.797347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:55.892741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1057/2118] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:55.894126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.038071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224788-c2af-47ca-8f17-881406af61e9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.043740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.044424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.044762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.045035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.045851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.051387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14dea2-eb6d-4f9c-93e1-5fa397d4b107 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.083977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1062/2119] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:56.088108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.099975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ff00-64a9-4814-ae1d-2036fab4db06 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.161632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.161937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.162197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.194990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.195613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.196030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.196303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.197019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.198943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.206087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:56.207504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.233261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1058/2120] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:56.240284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.251560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc01ac-ae35-4cf5-affa-61f00245726e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.257260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.257883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.258164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.258439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.259164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.260986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.276208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1059/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:56.277033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1063/2122] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:56.277145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.277749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.278900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.295379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79724-7826-4609-8972-a0a064122c07 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.298233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff098d6-0bd5-4d7a-9fad-de17a4174726 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.301000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.301726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.302031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.302298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.302945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.304270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.304917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.305014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.305218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.305489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] PATH_INFO: `/v3/users/2d14fa9514704c598657d6ee4ec79df0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.306805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d14fa9514704c598657d6ee4ec79df0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.309244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.319427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1064/2123] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:56.319427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.319427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.341809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:56.364738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d14fa9514704c598657d6ee4ec79df0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:56.372891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d14fa9514704c598657d6ee4ec79df0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:56.373528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d14fa9514704c598657d6ee4ec79df0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:56.374180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d14fa9514704c598657d6ee4ec79df0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:56.382735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:56.388370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d14fa9514704c598657d6ee4ec79df0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:56.395198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75579e-bad2-4557-b25e-90d836fc522b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.400823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.401433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.401711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.402006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.403075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1060/2124] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:56 2022] DELETE /identity/v3/users/2d14fa9514704c598657d6ee4ec79df0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:56.403854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.403979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.405163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.415182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.416848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c967b0-e9e4-48af-a33f-f4f489db39d2 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.425381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1065/2125] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:01:56.433200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.433490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.433764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.456965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:56.457356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.505528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1eb31-d22a-42bb-9c26-0fcc343fc944 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.512495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.513506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.514038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.514317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] PATH_INFO: `/v3/projects/9e7ccbcdf2514997a10d6360931ab76b/users/1fe5acc0647d4aea8085167b8b975fb7/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.528855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1066/2126] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:56.531026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7ccbcdf2514997a10d6360931ab76b, user_id=1fe5acc0647d4aea8085167b8b975fb7, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.533818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f902a2-11a5-403b-a656-8fba9afa08b4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.538866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.540368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.549027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1061/2127] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:56 2022] PUT /identity/v3/projects/9e7ccbcdf2514997a10d6360931ab76b/users/1fe5acc0647d4aea8085167b8b975fb7/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:56.560886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.561185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.561444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.592034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] MFA Rules not processed for user `1fe5acc0647d4aea8085167b8b975fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:56.593301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.607577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b520388-dcbc-40c0-84b8-ac78e4654a61 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.666425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1062/2128] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:56.666827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.667527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.667870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.668208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.671432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.693158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:56.734578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:56.740995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.741488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47ea0a-c073-4649-8fee-3086ad632844 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.742719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9c971-8099-44d1-a041-9b85209e8cfc service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.747425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.748072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.748522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.749095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.749993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.752113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.753465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1067/2129] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:56.762219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.762722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.763112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.785227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:56.786438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.787491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1063/2130] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:01:56.791490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.868713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1068/2131] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:56.874043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf5ed3-1d10-46c2-9e25-0382ca0462fd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.880932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.881754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.882284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.882726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.883410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.883600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.885275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:56.885587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.918826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1064/2132] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:56 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:01:56.924283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.936303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1aa3-e714-4ecc-a904-dbbcbe04c268 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.943399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.944003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.944288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.944563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.945258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:56.946913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:56.960694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1065/2133] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:01:56.961669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:56.972197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb890-d361-42d3-bbdb-f412f2c765d6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.973795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f63cb-51aa-4354-a446-5d262d67f96a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:56.977229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.978225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.978666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.978945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] PATH_INFO: `/v3/projects/7c43fcff087841b58b9be5d6a96d86b7/users/8c78d3a8d964412fb936530631a7ae10/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.979344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:56.980119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:56.980487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:56.980904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:56.997681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c43fcff087841b58b9be5d6a96d86b7, user_id=8c78d3a8d964412fb936530631a7ae10, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.001834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.006260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.009073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.031448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1066/2134] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:56 2022] PUT /identity/v3/projects/7c43fcff087841b58b9be5d6a96d86b7/users/8c78d3a8d964412fb936530631a7ae10/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:57.031901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1069/2135] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 07:01:57.035741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.089817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.091752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.128996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11477f3-c2e3-4ae1-bae0-ae155e9d29a0 service swift] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.177802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80590-b5c4-4309-9d58-b0a66cd2b187 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.185149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.186879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.187165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.187547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.188207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.191146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.208622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1067/2136] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:01:57.210625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:57.211482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.221299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.221986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.223503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.223828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] PATH_INFO: `/v3/projects/a9ab17310ea34f85889312a54dba083e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.224962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ab17310ea34f85889312a54dba083e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.227318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.227431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71f428-a5d7-4dcf-a0c6-b4d77b4359b4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.232649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.234080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.234496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.234877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] PATH_INFO: `/v3/projects/7c43fcff087841b58b9be5d6a96d86b7/users/8c78d3a8d964412fb936530631a7ae10/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.239737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c43fcff087841b58b9be5d6a96d86b7, user_id=8c78d3a8d964412fb936530631a7ae10, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.242170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cacc3-9576-46be-94fb-864faf92792c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.263596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1068/2137] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:01:57 2022] PUT /identity/v3/projects/7c43fcff087841b58b9be5d6a96d86b7/users/8c78d3a8d964412fb936530631a7ae10/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:57.274749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.275114 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.275479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.289609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ab17310ea34f85889312a54dba083e', 'request_id': 'req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.298666 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ab17310ea34f85889312a54dba083e', 'request_id': 'req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.307376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ab17310ea34f85889312a54dba083e', 'request_id': 'req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.307717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] MFA Rules not processed for user `8c78d3a8d964412fb936530631a7ae10`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:57.309333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.314964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:57.325618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] The token cache is being invalidate because project a9ab17310ea34f85889312a54dba083e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:57.326071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.326962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.328697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1070/2138] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:57 2022] DELETE /identity/v3/projects/a9ab17310ea34f85889312a54dba083e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:57.333884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.336078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.412721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1069/2139] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:57.425426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.426123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.441248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4586aa-c19f-480b-9fb8-49cd0c6e2ac8 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.448758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.449480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.449836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.450185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] PATH_INFO: `/v3/users/1d43ae94be97449581b207080642a670` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.451463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d43ae94be97449581b207080642a670)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.453563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.520132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f9c76-b9e7-480b-8cb6-19ef07082d4a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.524870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.525822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.526244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.526672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.528819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.537206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d43ae94be97449581b207080642a670'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.548673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d43ae94be97449581b207080642a670'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.550493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d43ae94be97449581b207080642a670'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.551147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d43ae94be97449581b207080642a670'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.559383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2a8cbe1a-00eb-439d-b266-83259bcf4344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d43ae94be97449581b207080642a670'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:57.576645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:57.582959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1071/2140] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:57 2022] DELETE /identity/v3/users/1d43ae94be97449581b207080642a670 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:57.584682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.588973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.589636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.615179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.616697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.631247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1070/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:01:57.638265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:57.639782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.746567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1072/2142] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:01:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:57.767957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:57.769652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:57.861515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:57.879000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b55988-47d2-43d9-b8ca-de02cd52838e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:57.969489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:57.970850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:57.971241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:57.972460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:57.986126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:57.988440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d361eb2-697a-4297-a0c9-eda94ff4b0f3 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:57.999907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1071/2143] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:01:58.059733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:58.062018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:58.199150 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b262d48-eb33-44c8-8578-e5a0983c3ae4 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:58.207677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:58.208599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:58.209135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:58.209555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] PATH_INFO: `/v3/projects/18fddac5eaf74d0bb1a61fb41c8c0ec3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:58.210869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fddac5eaf74d0bb1a61fb41c8c0ec3)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:58.213711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:58.284156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:58.284909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:58.285260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:58.309591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fddac5eaf74d0bb1a61fb41c8c0ec3', 'request_id': 'req-8f872ad5-0435-4be4-a49a-b59d939d7008'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.329299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] MFA Rules not processed for user `914b572d048f4f7ca4587d97e0a42f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:58.331087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:58.333049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fddac5eaf74d0bb1a61fb41c8c0ec3', 'request_id': 'req-8f872ad5-0435-4be4-a49a-b59d939d7008'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.344705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fddac5eaf74d0bb1a61fb41c8c0ec3', 'request_id': 'req-8f872ad5-0435-4be4-a49a-b59d939d7008'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.382040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] The token cache is being invalidate because project 18fddac5eaf74d0bb1a61fb41c8c0ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:58.382901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.385462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.389073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1073/2144] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:58 2022] DELETE /identity/v3/projects/18fddac5eaf74d0bb1a61fb41c8c0ec3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:58.393755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:58.395852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:58.524603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:58.525235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1072/2145] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:01:58.561583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f872ad5-0435-4be4-a49a-b59d939d7008 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:58.568343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:58.569090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:58.569467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:58.569976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] PATH_INFO: `/v3/users/e2db5e0113ce4013afab4cec8505b04c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:58.571830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2db5e0113ce4013afab4cec8505b04c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:58.574919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:58.694022 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2db5e0113ce4013afab4cec8505b04c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.720700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2db5e0113ce4013afab4cec8505b04c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.722498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2db5e0113ce4013afab4cec8505b04c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.723485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2db5e0113ce4013afab4cec8505b04c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.735554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9af91c1b-594d-413f-a8e6-ebd56658acec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2db5e0113ce4013afab4cec8505b04c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:58.776848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1074/2146] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:01:58 2022] DELETE /identity/v3/users/e2db5e0113ce4013afab4cec8505b04c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:01:59.224607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:59.261258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8a28-0461-4baa-8792-007f9f818921 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:59.399620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:59.400276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.400552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.401130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] PATH_INFO: `/v3/projects/edd13e577ffa449ba2af1b24e45c4897` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.402657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd13e577ffa449ba2af1b24e45c4897)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:59.404616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:59.523148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:01:59.541833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd13e577ffa449ba2af1b24e45c4897', 'request_id': 'req-277c9130-c098-4abc-a023-d7c76e808825'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:59.559147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd13e577ffa449ba2af1b24e45c4897', 'request_id': 'req-277c9130-c098-4abc-a023-d7c76e808825'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:59.574736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd13e577ffa449ba2af1b24e45c4897', 'request_id': 'req-277c9130-c098-4abc-a023-d7c76e808825'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:59.588387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] The token cache is being invalidate because project edd13e577ffa449ba2af1b24e45c4897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:01:59.588718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:59.589382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:01:59.595509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1073/2147] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:01:59 2022] DELETE /identity/v3/projects/edd13e577ffa449ba2af1b24e45c4897 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:01:59.598384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a919a-6125-4f94-9bcc-4cc0123af92f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.598936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a919a-6125-4f94-9bcc-4cc0123af92f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.599491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a919a-6125-4f94-9bcc-4cc0123af92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.624434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:59.624434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:59.643400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b63a919a-6125-4f94-9bcc-4cc0123af92f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:59.644919 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b63a919a-6125-4f94-9bcc-4cc0123af92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:59.747172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c9130-c098-4abc-a023-d7c76e808825 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:59.759005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1075/2148] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:59.760995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:59.761262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.761961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.762254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.769168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:59.769350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.769709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.770185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.826114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:01:59.827928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:01:59.840816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1076/2149] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:01:59.846464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:59.868708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e52a-abca-4d6a-bc20-7f6f98ed1725 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:59.876967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:59.877721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.878312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.878630 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.879361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:01:59.879681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:59.882278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:59.895090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:59.897636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1077/2150] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:01:59.902684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:01:59.903787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:59.922054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1074/2151] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:01:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:01:59.927989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424edb-8250-41cc-b879-bab7cfd35e4b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:01:59.934136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:01:59.934884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:01:59.935234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:01:59.935583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:01:59.936292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:01:59.938320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:01:59.995519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1078/2152] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:01:59 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:00.000035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.025935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b752-7ef8-41ea-aac1-9a08fcee0265 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.126949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.128076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.128491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.128963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.130205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.132809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.169302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1075/2153] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:01:59 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:00.173307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.191185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a538283-6fd5-4406-88ed-21cf680dd733 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.204816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.204816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.204816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.204816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.210257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.210257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.240660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1079/2154] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:00.248336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.267213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875ef9-d977-4967-9c93-027dd62af813 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.287042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.287732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.288148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.288486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.289212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.290972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200d59-c89d-4fc4-87c2-affaa4c8b6a3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.294461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:00.309739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1076/2155] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:00.314170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.321025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:00.331525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195732ba-fa34-4386-94d6-11d14232756b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.347235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.349377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.349952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.350461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] PATH_INFO: `/v3/projects/ea5445d85ce0439da6c3278aa786720a/users/7eea2bb4875e462fb3e6813f44153c7f/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.380832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5445d85ce0439da6c3278aa786720a, user_id=7eea2bb4875e462fb3e6813f44153c7f, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.385480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.401739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1080/2156] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:00 2022] PUT /identity/v3/projects/ea5445d85ce0439da6c3278aa786720a/users/7eea2bb4875e462fb3e6813f44153c7f/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:00.414517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.415101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.416088 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.450471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] MFA Rules not processed for user `7eea2bb4875e462fb3e6813f44153c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:00.452056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:00.542255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1077/2157] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:00.549536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.658210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd79cd7-72ec-4a9d-92ab-922b2b2a4849 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.664502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.665214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.665504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.666035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.666686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.668660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.699257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1081/2158] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:00.705750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.713288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.715949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:00.732089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053de1-f112-4df3-9f1f-8f1b36109ece None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.808169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.808960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.809340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.809714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.809819 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e80413-6330-480b-8ed0-0886b0f93cc5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.810536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.812678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.816202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.816874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.817154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.817423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] PATH_INFO: `/v3/users/6d61e2fc1beb42c4bdedf0a32fab2930` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.818567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d61e2fc1beb42c4bdedf0a32fab2930)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.820913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.836962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1078/2159] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:00 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:00.845361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.859808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570366-cc48-434e-b1df-8cd4ab4cdbed admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.865860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.866532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.866902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.867179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.867876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.869607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.889754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1079/2160] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:00.893470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.909468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bdab9-5694-46e9-a899-fb71884582f9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:00.913644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d61e2fc1beb42c4bdedf0a32fab2930'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:00.927899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d61e2fc1beb42c4bdedf0a32fab2930'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:00.930371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d61e2fc1beb42c4bdedf0a32fab2930'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:00.931845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d61e2fc1beb42c4bdedf0a32fab2930'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:00.936157 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:00.937075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:00.937515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:00.937907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] PATH_INFO: `/v3/projects/62098ccb8b774bd2af4846f3d1e63170/users/34663447aff249fe809176dfb3ad7388/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:00.942691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d61e2fc1beb42c4bdedf0a32fab2930'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:00.950376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:00.972793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62098ccb8b774bd2af4846f3d1e63170, user_id=34663447aff249fe809176dfb3ad7388, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:00.980526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748bda2-bc8c-4e7a-9b08-05e77f2f9e33 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:00.994902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1082/2161] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:00 2022] DELETE /identity/v3/users/6d61e2fc1beb42c4bdedf0a32fab2930 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:00.994902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:00.996608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.009467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1080/2162] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:00 2022] PUT /identity/v3/projects/62098ccb8b774bd2af4846f3d1e63170/users/34663447aff249fe809176dfb3ad7388/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:01.015541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.015766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.016073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.049800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:01.051361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.075477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1760-329a-4f64-b3a9-39e112d2a73d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.124731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:01.167241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1081/2163] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:01.168108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:01.173181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.182357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.183126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.183842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.184310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.186389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.190777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5625cb-9811-4c14-b62e-eed0ea2fc8b9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.197302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.197491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.197827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.198169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.198895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:01.200770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:01.212916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1082/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:01.217433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:01.219501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.292689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:01.294664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:01.300426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacda6f-8f29-453e-b76a-3dd56b74d5d4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.305216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.306574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.307013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.307290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.312458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1083/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:01.318006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:01.318775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:01.320756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e0844-5c60-414f-bd17-887c63b3d3e4 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:01.330463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b094a-9725-4ece-af7e-dac393ad4eb5 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.336064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.336762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1083/2166] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:01.341247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.341544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.341864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] PATH_INFO: `/v3/projects/62098ccb8b774bd2af4846f3d1e63170/users/34663447aff249fe809176dfb3ad7388/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.344184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62098ccb8b774bd2af4846f3d1e63170, user_id=34663447aff249fe809176dfb3ad7388, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:01.349644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:01.392192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1084/2167] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:01 2022] PUT /identity/v3/projects/62098ccb8b774bd2af4846f3d1e63170/users/34663447aff249fe809176dfb3ad7388/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:01.407905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.409534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.410344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.468785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] MFA Rules not processed for user `34663447aff249fe809176dfb3ad7388`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:01.470205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.603066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1084/2168] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:01.618976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:01.621805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.640557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:01.645052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.721607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:01.778703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce0c89-cb0d-4869-858f-86407786d041 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.785516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.786167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.786491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.786767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] PATH_INFO: `/v3/projects/6d3007c2d6f5432b843a3a63adda02b8` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.788142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3007c2d6f5432b843a3a63adda02b8)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:01.790742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:01.856031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3007c2d6f5432b843a3a63adda02b8', 'request_id': 'req-0ae94401-a9da-46b1-950f-e12f554017a1'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:01.868885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3007c2d6f5432b843a3a63adda02b8', 'request_id': 'req-0ae94401-a9da-46b1-950f-e12f554017a1'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:01.881577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3007c2d6f5432b843a3a63adda02b8', 'request_id': 'req-0ae94401-a9da-46b1-950f-e12f554017a1'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:01.882361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa7e3-045e-4cc1-bd14-9518a8421020 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:01.906583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] The token cache is being invalidate because project 6d3007c2d6f5432b843a3a63adda02b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:01.906877 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:01.907561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-0ae94401-a9da-46b1-950f-e12f554017a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:01.909401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:01.913423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1085/2169] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:01 2022] DELETE /identity/v3/projects/6d3007c2d6f5432b843a3a63adda02b8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:01.915184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35949-5e4f-478a-aa30-1af590db21cd None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.915738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35949-5e4f-478a-aa30-1af590db21cd None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.915856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35949-5e4f-478a-aa30-1af590db21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.941082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-52d35949-5e4f-478a-aa30-1af590db21cd None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:01.942332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-52d35949-5e4f-478a-aa30-1af590db21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:01.956819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:01.957737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:01.957891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:01.958102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:01.961369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.033821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1086/2170] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:02.041934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.042223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.042494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.048015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.050627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.062276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1085/2171] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:02:02.070810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:02.072561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.082887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1087/2172] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:02.088414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.100657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c397ab-1c97-450a-b94a-3f67c46f4fb7 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.106344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.107038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.107377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.107749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.108919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:02.109677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.110988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.129893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1086/2173] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:02.130970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.143565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab11a4f-1ce0-46f3-b661-f94f8d3b4a32 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.151181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.151798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.152279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.152553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.153248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.155303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.179045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.182594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.192901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1088/2174] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:02 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:02.195389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.196827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee51658-a729-4cb9-9354-b119d9b0ef9d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.244767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:02.262134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.263029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.263473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.264333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.266894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.276628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b111d1-594d-4443-ad9d-8f5a4a99cd02 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.281748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.282526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.282896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.283263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.284540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.286215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.314543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1089/2175] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:02 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:02.316491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.326703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe238f7-154a-4a2a-a9db-f954316dc775 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.331746 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.332348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.332661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.332937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.333586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.335211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.343678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.345198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.347064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1090/2176] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:02.351343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.358101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1087/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:02:02.363985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211550-4d62-4eb6-87cc-c05f9d80b7f2 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.369251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.370254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.370607 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.371672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.372412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.374206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f552-11f7-4b0a-9fa8-4fc99baf7949 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.385192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1091/2178] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:02.388944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.401372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf8561-4fe1-4427-bb30-a2bbeb432590 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.406172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.406781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.407062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.407365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] PATH_INFO: `/v3/projects/7de1021fb2a4458ca54e04e21abc32cd/users/f96b57f91667443c9ee3fdfd3cffeb7c/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.410533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:02.425232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de1021fb2a4458ca54e04e21abc32cd, user_id=f96b57f91667443c9ee3fdfd3cffeb7c, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.428224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.444718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1088/2179] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:02 2022] PUT /identity/v3/projects/7de1021fb2a4458ca54e04e21abc32cd/users/f96b57f91667443c9ee3fdfd3cffeb7c/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:02.450153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.450675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.452059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.471254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:02.472771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.575752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1092/2180] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:02.588352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:02.590513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:02.734736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d356-9ba2-4300-abb1-39c501d18e4b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:02.739429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:02.740548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:02.740952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:02.741283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:02.763143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:02.764638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23526df-b5d2-4877-8d10-124e565a4bec service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:02.788659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1089/2181] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:05.114424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:05.116680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:05.150781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d30b-6f5d-44b3-9663-c972060c3ede None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:05.160699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:05.161318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:05.161599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:05.161865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] PATH_INFO: `/v3/users/7eea2bb4875e462fb3e6813f44153c7f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:05.165407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eea2bb4875e462fb3e6813f44153c7f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:05.167411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:05.226133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eea2bb4875e462fb3e6813f44153c7f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.236821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eea2bb4875e462fb3e6813f44153c7f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.238035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eea2bb4875e462fb3e6813f44153c7f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.238799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eea2bb4875e462fb3e6813f44153c7f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.247627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eea2bb4875e462fb3e6813f44153c7f'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.278899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1093/2182] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:05 2022] DELETE /identity/v3/users/7eea2bb4875e462fb3e6813f44153c7f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:05.279086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:05.279086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:05.279564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:05.314354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:05.318786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:05.459601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1090/2183] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:05.481091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:05.483024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:05.516920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:05.579587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba066c-3722-4ef0-bf72-dc01032286be admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:05.584471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:05.585153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:05.585434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:05.585704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:05.597166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:05.599207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b3b0c-47a6-4840-82d0-7e5cbdd38745 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:05.608204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:05.609717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:05.616963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1094/2184] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:05.623865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd45d4-02f0-4b02-b2bb-acdc628dead0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:05.629120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:05.629785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:05.630328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:05.630991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] PATH_INFO: `/v3/users/18c9530da2894230ad525278c63ccbb9` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:05.631862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c9530da2894230ad525278c63ccbb9)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:05.634628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:05.735843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c9530da2894230ad525278c63ccbb9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.747572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c9530da2894230ad525278c63ccbb9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.748364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c9530da2894230ad525278c63ccbb9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.749200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c9530da2894230ad525278c63ccbb9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.767948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c9530da2894230ad525278c63ccbb9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:05.781382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:05.792307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1091/2185] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:05 2022] DELETE /identity/v3/users/18c9530da2894230ad525278c63ccbb9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:05.797088 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:05.797473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:05.798125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:05.826603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:05.828529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:05.961431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1095/2186] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:05.998767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:06.001343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:06.022311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:06.024091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:06.047013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2afb8-801f-4db6-ba08-924583941f41 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:06.054825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:06.055478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:06.055755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:06.056025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] PATH_INFO: `/v3/projects/ea5445d85ce0439da6c3278aa786720a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:06.057225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5445d85ce0439da6c3278aa786720a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:06.059359 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:06.141104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e096351-b03a-4eae-96c1-612761e8f47c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:06.166699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5445d85ce0439da6c3278aa786720a', 'request_id': 'req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.192355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5445d85ce0439da6c3278aa786720a', 'request_id': 'req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.200865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5445d85ce0439da6c3278aa786720a', 'request_id': 'req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.234541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] The token cache is being invalidate because project ea5445d85ce0439da6c3278aa786720a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:06.234805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.235701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.245010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1096/2187] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:06 2022] DELETE /identity/v3/projects/ea5445d85ce0439da6c3278aa786720a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:06.246030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:06.249381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:06.267924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:06.268692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:06.269069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:06.269623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:06.274816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:06.385982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:06.390607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:06.392291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:06.404978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1092/2188] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:02:06.416861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4920-f8b0-4f53-ac4a-d6ccfad587bd admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:06.423615 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:06.425108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:06.425486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:06.425860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] PATH_INFO: `/v3/users/34663447aff249fe809176dfb3ad7388` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:06.427162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=34663447aff249fe809176dfb3ad7388)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:06.429650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:06.503700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34663447aff249fe809176dfb3ad7388'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.512737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34663447aff249fe809176dfb3ad7388'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.513577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34663447aff249fe809176dfb3ad7388'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.514936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34663447aff249fe809176dfb3ad7388'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.524219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-42f0ae81-2b9e-4ee9-abdf-9b133e9dbfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34663447aff249fe809176dfb3ad7388'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:06.544465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1097/2189] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:06 2022] DELETE /identity/v3/users/34663447aff249fe809176dfb3ad7388 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:07.059381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.072642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8cfac-11aa-4597-a0fd-740c04e3960a service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.137003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.137719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.137998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.138333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] PATH_INFO: `/v3/projects/62098ccb8b774bd2af4846f3d1e63170` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.139562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62098ccb8b774bd2af4846f3d1e63170)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.141520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.149668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:07.196436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62098ccb8b774bd2af4846f3d1e63170', 'request_id': 'req-8f262be5-9563-4dbc-8312-9c15af9c4376'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.203363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62098ccb8b774bd2af4846f3d1e63170', 'request_id': 'req-8f262be5-9563-4dbc-8312-9c15af9c4376'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.214517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62098ccb8b774bd2af4846f3d1e63170', 'request_id': 'req-8f262be5-9563-4dbc-8312-9c15af9c4376'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.229441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] The token cache is being invalidate because project 62098ccb8b774bd2af4846f3d1e63170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:07.229823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.230541 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8f262be5-9563-4dbc-8312-9c15af9c4376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.232863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1093/2190] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:07 2022] DELETE /identity/v3/projects/62098ccb8b774bd2af4846f3d1e63170 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:07.239192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.239708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.240271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.265061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:07.267131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:07.358341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1098/2191] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:07.366645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.367270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.367372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.390465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:07.391795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:07.410941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.416806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1094/2192] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:07.425844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4f2b-b70b-4694-98d6-56dbda6d6852 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.433703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.435295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.436882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.437229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.438044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:07.438423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.442090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.460480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1099/2193] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:07.461489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.471124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c486-20bc-4096-81df-07ce36f2b208 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.476011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.476785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.477063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.477587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.477962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.479918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.581735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1095/2194] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:07 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:07.585781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.606230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b88c-ba79-4b78-8c28-081803d16bb0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.674947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.677063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:07.735559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:07.750375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.751037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.751312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.751604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.752999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.755749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.788631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1100/2195] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:07 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:07.793161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.804335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95b73-3687-47c1-bc0c-7a3c853b6fa5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.810693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.811299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.811574 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.811858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.812568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.814450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.828305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1101/2196] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:07.833803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.835713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce819b-76db-45ed-a267-ad89b4770ee3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.844628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.845556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.845815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a0084-a5d1-4b12-b223-47992545de8d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.846845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.847482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] PATH_INFO: `/v3/projects/41d40c8f538d4a679f57c3bfd386cb49` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.848963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d40c8f538d4a679f57c3bfd386cb49)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.851744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.852323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.852843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.853907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.854422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.855300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.857245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.870588 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1102/2197] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:07.874354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.888662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a0ed-bfec-4840-86ac-30133994de42 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:07.896668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:07.898327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.898821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.899364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] PATH_INFO: `/v3/projects/2cf84ab9f9f243cc8c790dfa81968b28/users/ec41d2c7264d473f8ecad98cd21c76a9/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.920924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d40c8f538d4a679f57c3bfd386cb49', 'request_id': 'req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.921646 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf84ab9f9f243cc8c790dfa81968b28, user_id=ec41d2c7264d473f8ecad98cd21c76a9, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:07.925427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df70de5-c173-4b29-a78e-a5b8a6b46abf admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:07.928313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d40c8f538d4a679f57c3bfd386cb49', 'request_id': 'req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.941437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d40c8f538d4a679f57c3bfd386cb49', 'request_id': 'req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.949700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:07.953467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1103/2198] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:07 2022] PUT /identity/v3/projects/2cf84ab9f9f243cc8c790dfa81968b28/users/ec41d2c7264d473f8ecad98cd21c76a9/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:07.969967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:07.970261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:07.970535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:07.976452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] The token cache is being invalidate because project 41d40c8f538d4a679f57c3bfd386cb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:07.977301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.978163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:07.980959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1096/2199] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:07 2022] DELETE /identity/v3/projects/41d40c8f538d4a679f57c3bfd386cb49 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:07.984989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:07.988140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:08.042319 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] MFA Rules not processed for user `ec41d2c7264d473f8ecad98cd21c76a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:08.043559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:08.122811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9d0bf-cf54-4f83-8be0-1e1b21fb95dd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.197410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1104/2200] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:08.202265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:08.209538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:08.259202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.259865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.260142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.260413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] PATH_INFO: `/v3/users/1fe5acc0647d4aea8085167b8b975fb7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.261639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe5acc0647d4aea8085167b8b975fb7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.264726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.353039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958b21f-93c0-436e-bc9d-6582957dee11 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.359424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.360435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.361153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.362295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.362713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe5acc0647d4aea8085167b8b975fb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:08.363154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.366181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.374921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe5acc0647d4aea8085167b8b975fb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:08.375780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe5acc0647d4aea8085167b8b975fb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:08.376494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe5acc0647d4aea8085167b8b975fb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:08.394417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe5acc0647d4aea8085167b8b975fb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:08.411625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1097/2201] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:07 2022] DELETE /identity/v3/users/1fe5acc0647d4aea8085167b8b975fb7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:08.422498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1105/2202] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:08 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:08.423712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:08.425382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:08.459107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:08.517311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0ca52-79a6-41bc-bf21-ba8a9b199074 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.645762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.645762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.645762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.645762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.646467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.646467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.684897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1098/2203] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:08 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:08.688608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:08.705618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0637bb-2043-4fb8-a6e1-4260103f751d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.717037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.719048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.719720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.721997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.723125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.726250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.730313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:08.751087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1106/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:08.755621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:08.771061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d989-81ed-4cbd-ad37-1d9763867ad5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.787656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.788699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.789196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.789456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.790195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.792305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934a46-f88b-4ead-8433-cb229ffbe01f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.819393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1099/2205] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:08.823261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:08.835870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6df70-2fdd-442d-86c7-8f5c604463cb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:08.841905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:08.843706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.844169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.844660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] PATH_INFO: `/v3/projects/12a07338267d4924ac4dd829475cc7f8/users/0e0c0f5c5817416ea372c60c58585dce/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.867009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a07338267d4924ac4dd829475cc7f8, user_id=0e0c0f5c5817416ea372c60c58585dce, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:08.871005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:08.897962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1107/2206] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:08 2022] PUT /identity/v3/projects/12a07338267d4924ac4dd829475cc7f8/users/0e0c0f5c5817416ea372c60c58585dce/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:08.914413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:08.914784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:08.915156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:08.980986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] MFA Rules not processed for user `0e0c0f5c5817416ea372c60c58585dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:08.985080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:09.126441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.129471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:09.142952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1100/2207] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:09.146186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.240970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:09.293043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d299b-aa52-4816-a8d9-e6e14a3b8b94 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.299226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.299860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.300140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.300408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.301076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.301205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0848215-90dc-4abc-8616-73e76b566df3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.302991 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.306869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.307698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.308077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.308716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] PATH_INFO: `/v3/projects/9e7ccbcdf2514997a10d6360931ab76b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.310675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7ccbcdf2514997a10d6360931ab76b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.313162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.354309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1101/2208] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:09 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:09.358930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.397623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7ccbcdf2514997a10d6360931ab76b', 'request_id': 'req-51437c6c-8d81-4cb1-b51a-3896f6fba617'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.431472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7ccbcdf2514997a10d6360931ab76b', 'request_id': 'req-51437c6c-8d81-4cb1-b51a-3896f6fba617'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.478739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944ffba-0759-419a-b9f9-da0b8baca0af admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.479194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7ccbcdf2514997a10d6360931ab76b', 'request_id': 'req-51437c6c-8d81-4cb1-b51a-3896f6fba617'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.501600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] The token cache is being invalidate because project 9e7ccbcdf2514997a10d6360931ab76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:09.501922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.503708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.513602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1108/2209] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:09 2022] DELETE /identity/v3/projects/9e7ccbcdf2514997a10d6360931ab76b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:09.514671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.516497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:09.670296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51437c6c-8d81-4cb1-b51a-3896f6fba617 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.684085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.685063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.685696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.686221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] PATH_INFO: `/v3/users/8c78d3a8d964412fb936530631a7ae10` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.687837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c78d3a8d964412fb936530631a7ae10)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.689278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.690528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.690805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.691068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.691714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.693396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.693676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.708003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:09.748857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1102/2210] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:09 2022] POST /identity/v3/users => generated 296 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:09.754389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.756912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:09.788118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b798-5863-4af2-8b5c-16e9149748bb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.801377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.802007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.802286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.802555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.803232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.805143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.807736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c78d3a8d964412fb936530631a7ae10'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.817670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c78d3a8d964412fb936530631a7ae10'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.819205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c78d3a8d964412fb936530631a7ae10'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.820285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c78d3a8d964412fb936530631a7ae10'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.827022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1103/2211] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:09.828116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:09.834608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c78d3a8d964412fb936530631a7ae10'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:09.838797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:09.873408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c438c-8c6e-4233-9de8-604b75f975c5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:09.882035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:09.883305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:09.883656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:09.885484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] PATH_INFO: `/v3/projects/be013053acfa448fa7549e6f70b915ab/users/eb62ded662144ee88535137fc9fe2cb3/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:09.902388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1109/2212] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:09 2022] DELETE /identity/v3/users/8c78d3a8d964412fb936530631a7ae10 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:09.923022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=be013053acfa448fa7549e6f70b915ab, user_id=eb62ded662144ee88535137fc9fe2cb3, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:09.927452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:09.952854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1104/2213] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:09 2022] PUT /identity/v3/projects/be013053acfa448fa7549e6f70b915ab/users/eb62ded662144ee88535137fc9fe2cb3/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:09.954598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.045795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e0869-8120-4645-a39d-232325150aea admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.132349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.133617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.135648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.136356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.139945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:10.145308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31673-aa9d-42d2-ade2-709d7b4a5678 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:10.178261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.178505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1110/2214] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:10.196658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ff702-4e81-4d7c-a0b5-0ee7b0f648bc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.215914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.217828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.218808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.219154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] PATH_INFO: `/v3/projects/be013053acfa448fa7549e6f70b915ab/users/eb62ded662144ee88535137fc9fe2cb3/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.226785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=be013053acfa448fa7549e6f70b915ab, user_id=eb62ded662144ee88535137fc9fe2cb3, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:10.229984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56a75-553e-40ad-934f-a326165a94ac admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:10.256701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.257071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.257428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.258726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1105/2215] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:10 2022] PUT /identity/v3/projects/be013053acfa448fa7549e6f70b915ab/users/eb62ded662144ee88535137fc9fe2cb3/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:10.320655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] MFA Rules not processed for user `eb62ded662144ee88535137fc9fe2cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:10.322685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.343404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:10.406634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.407651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.407907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.441061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:10.453793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] MFA Rules not processed for user `f96b57f91667443c9ee3fdfd3cffeb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:10.457733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.467815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1111/2216] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:10.468943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.482134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.561081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1106/2217] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:10.563206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.565799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.590890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a3c9-6d96-4123-afd3-460bb7a2e95a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.598453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.599118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.599406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.599939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] PATH_INFO: `/v3/projects/7c43fcff087841b58b9be5d6a96d86b7` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.601217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c43fcff087841b58b9be5d6a96d86b7)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:10.604494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:10.639850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8320f-9815-4775-8033-3815485155d8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.646656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.647296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.647587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.647821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.666540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:10.668312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:10.708433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1107/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:10.709680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.709903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c43fcff087841b58b9be5d6a96d86b7', 'request_id': 'req-fffe650e-7338-46c8-9202-590764b55ac9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:10.711243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.721728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c43fcff087841b58b9be5d6a96d86b7', 'request_id': 'req-fffe650e-7338-46c8-9202-590764b55ac9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:10.732719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c39e1-264d-4642-990a-e21dbe837c44 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.734885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c43fcff087841b58b9be5d6a96d86b7', 'request_id': 'req-fffe650e-7338-46c8-9202-590764b55ac9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:10.764082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] The token cache is being invalidate because project 7c43fcff087841b58b9be5d6a96d86b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:10.764217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:10.773085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:10.773085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1112/2219] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:10 2022] DELETE /identity/v3/projects/7c43fcff087841b58b9be5d6a96d86b7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:10.784397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.788472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.895934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.899021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.899021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.899320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.899926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:10.905268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:10.907681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:10.929121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe650e-7338-46c8-9202-590764b55ac9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:10.939496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:10.939496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:10.939496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:10.939496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:10.942016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:10.978828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1108/2220] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:10 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:10.981070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:10.984293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:11.022075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.023639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.032487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:11.035271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1113/2221] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:11.081704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2769f-aed0-45d6-8052-83e6f596dd5b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:11.087218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:11.088223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:11.088714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:11.089060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:11.089831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.091781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.119422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1109/2222] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:10 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:11.123551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:11.135737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64810e1-42e6-47b2-8611-b4f2f68402cd service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:11.142081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:11.143480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:11.143770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:11.144065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:11.144894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.148282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.160772 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1114/2223] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:11.164948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:11.175384 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cab4bb-9205-46f0-8e24-f6d546c6a352 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:11.182161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:11.182867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:11.183385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:11.183668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] PATH_INFO: `/v3/projects/ee636ff930044ba39e3774267562f137/users/10d219c8126e486fbf7881246c15f36d/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:11.202948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee636ff930044ba39e3774267562f137, user_id=10d219c8126e486fbf7881246c15f36d, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.205926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.223005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1110/2224] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:11 2022] PUT /identity/v3/projects/ee636ff930044ba39e3774267562f137/users/10d219c8126e486fbf7881246c15f36d/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:11.227050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:11.241769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e6cb1-66c5-4a29-a26d-a0d01fcafa06 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:11.337244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:11.337951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:11.338364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:11.338644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:11.339497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.341179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.354276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1115/2225] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:11.358014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:11.380510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d38ca-6f82-40ae-9ca9-d721bda80e65 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:11.427229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:11.428410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:11.430373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:11.431952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] PATH_INFO: `/v3/projects/ee636ff930044ba39e3774267562f137/users/10d219c8126e486fbf7881246c15f36d/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:11.437005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee636ff930044ba39e3774267562f137, user_id=10d219c8126e486fbf7881246c15f36d, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:11.445393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54f212-3a65-4f4d-b39a-4c400a36d782 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:11.478400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1111/2226] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:11 2022] PUT /identity/v3/projects/ee636ff930044ba39e3774267562f137/users/10d219c8126e486fbf7881246c15f36d/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:14.478182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:14.478182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:14.503623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538dd86-fcac-4589-8c05-aedcc5b5e959 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:14.674884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:14.675628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:14.675911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:14.683265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] PATH_INFO: `/v3/users/ec41d2c7264d473f8ecad98cd21c76a9` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:14.683445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec41d2c7264d473f8ecad98cd21c76a9)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:14.687664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:14.793470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:14.872670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec41d2c7264d473f8ecad98cd21c76a9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:14.888933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec41d2c7264d473f8ecad98cd21c76a9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:14.889730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec41d2c7264d473f8ecad98cd21c76a9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:14.890654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec41d2c7264d473f8ecad98cd21c76a9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:14.904495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec41d2c7264d473f8ecad98cd21c76a9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:14.939352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1116/2227] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:14 2022] DELETE /identity/v3/users/ec41d2c7264d473f8ecad98cd21c76a9 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:14.944675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:14.945256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:14.945543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:15.013847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:15.015317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:15.167285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1112/2228] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:15.181386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:15.183097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:15.270988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771100b2-195f-4476-a186-4299bd887651 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:15.276508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:15.277213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:15.277670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:15.277990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:15.293529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:15.295771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:15.347639 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1117/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:16.321888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:16.323500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:16.337329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200622-545e-418e-a748-08dacb1e1b32 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:16.343212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:16.344121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:16.344710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:16.345329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] PATH_INFO: `/v3/projects/2cf84ab9f9f243cc8c790dfa81968b28` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:16.347229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf84ab9f9f243cc8c790dfa81968b28)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:16.349177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:16.444850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf84ab9f9f243cc8c790dfa81968b28', 'request_id': 'req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.457955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf84ab9f9f243cc8c790dfa81968b28', 'request_id': 'req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.472551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf84ab9f9f243cc8c790dfa81968b28', 'request_id': 'req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.519074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] The token cache is being invalidate because project 2cf84ab9f9f243cc8c790dfa81968b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:16.519429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.520418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.527566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1113/2230] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:16 2022] DELETE /identity/v3/projects/2cf84ab9f9f243cc8c790dfa81968b28 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:16.531312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:16.542565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cba4-a9b1-499c-b363-aa9f016dfc24 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:16.636210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:16.637012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:16.637531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:16.637778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] PATH_INFO: `/v3/users/0e0c0f5c5817416ea372c60c58585dce` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:16.640087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0c0f5c5817416ea372c60c58585dce)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:16.642399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:16.727547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:16.729922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0c0f5c5817416ea372c60c58585dce'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.743142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0c0f5c5817416ea372c60c58585dce'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.745267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0c0f5c5817416ea372c60c58585dce'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.746528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0c0f5c5817416ea372c60c58585dce'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.767126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0c0f5c5817416ea372c60c58585dce'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:16.793277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1118/2231] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:16 2022] DELETE /identity/v3/users/0e0c0f5c5817416ea372c60c58585dce => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:17.562714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:17.564309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:17.583675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:17.597047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7db9-9d91-4cbf-ab76-0f8e021e4002 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:17.854416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:17.855293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:17.855580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:17.855855 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] PATH_INFO: `/v3/projects/12a07338267d4924ac4dd829475cc7f8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:17.857612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a07338267d4924ac4dd829475cc7f8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:17.860615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:18.013821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a07338267d4924ac4dd829475cc7f8', 'request_id': 'req-73205f0c-c037-46b5-b34a-9d060634bd76'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.048767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a07338267d4924ac4dd829475cc7f8', 'request_id': 'req-73205f0c-c037-46b5-b34a-9d060634bd76'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.089933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a07338267d4924ac4dd829475cc7f8', 'request_id': 'req-73205f0c-c037-46b5-b34a-9d060634bd76'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.134102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] The token cache is being invalidate because project 12a07338267d4924ac4dd829475cc7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:18.134403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.135067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73205f0c-c037-46b5-b34a-9d060634bd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.136764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1114/2232] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:17 2022] DELETE /identity/v3/projects/12a07338267d4924ac4dd829475cc7f8 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:18.141105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:18.144570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:18.175675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235178a-67ef-4233-b223-1f05206804bf admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:18.338173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:18.345847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:18.349570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:18.350085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] PATH_INFO: `/v3/users/eb62ded662144ee88535137fc9fe2cb3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:18.356251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb62ded662144ee88535137fc9fe2cb3)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:18.358736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:18.452439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb62ded662144ee88535137fc9fe2cb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.466495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb62ded662144ee88535137fc9fe2cb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.469186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb62ded662144ee88535137fc9fe2cb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.470758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb62ded662144ee88535137fc9fe2cb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.484948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f1b85442-e4c8-4e2b-a73c-6a9298f80723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb62ded662144ee88535137fc9fe2cb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:18.529127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1119/2233] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:18 2022] DELETE /identity/v3/users/eb62ded662144ee88535137fc9fe2cb3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:18.904962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea1ddd-febf-4feb-bc05-7768f7acc5ae None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:18.905892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea1ddd-febf-4feb-bc05-7768f7acc5ae None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:18.906373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea1ddd-febf-4feb-bc05-7768f7acc5ae None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:18.909704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1115/2234] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:02:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:02:18.926196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282204b-e003-447c-a0bb-3659aebfc11f None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:18.926487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282204b-e003-447c-a0bb-3659aebfc11f None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:18.926770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282204b-e003-447c-a0bb-3659aebfc11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:18.966714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-9282204b-e003-447c-a0bb-3659aebfc11f None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:18.968218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9282204b-e003-447c-a0bb-3659aebfc11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.021731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:19.100989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1120/2235] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:02:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:19.153368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8036755-1c32-4ffe-8ccb-6cb367130f97 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.159067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8036755-1c32-4ffe-8ccb-6cb367130f97 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.159761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8036755-1c32-4ffe-8ccb-6cb367130f97 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.162622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1116/2236] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 13 07:02:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:02:19.169524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.171392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.171850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.210755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] MFA Rules not processed for user `1db27bb68c344df38e0f3ad7e0df0b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:19.212842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.229688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1121/2237] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 13 07:02:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:19.244915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8036755-1c32-4ffe-8ccb-6cb367130f97 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:19.264515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8036755-1c32-4ffe-8ccb-6cb367130f97 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:19.272895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:19.280173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.280852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.281431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.295782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:19.297919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128b942-7a73-4bf7-a003-2b68f69c918d service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:19.320990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1117/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:19.521400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:19.523065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.602567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.602970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.603909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.651716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] MFA Rules not processed for user `10d219c8126e486fbf7881246c15f36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:19.654359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.674892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c5dca-9cd8-474a-ae46-ff7c9f7a3dc8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:19.680798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:19.681985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.682178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.682456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] PATH_INFO: `/v3/projects/be013053acfa448fa7549e6f70b915ab` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.683631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be013053acfa448fa7549e6f70b915ab)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:19.685906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:19.750196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1118/2239] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:19.768195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:19.770354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.777143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be013053acfa448fa7549e6f70b915ab', 'request_id': 'req-ce682854-20c4-496f-8e36-8961a1953fa2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:19.780736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:19.793139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be013053acfa448fa7549e6f70b915ab', 'request_id': 'req-ce682854-20c4-496f-8e36-8961a1953fa2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:19.800244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be013053acfa448fa7549e6f70b915ab', 'request_id': 'req-ce682854-20c4-496f-8e36-8961a1953fa2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:19.813087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] The token cache is being invalidate because project be013053acfa448fa7549e6f70b915ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:19.813381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:19.814112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ce682854-20c4-496f-8e36-8961a1953fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:19.815970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1122/2240] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:19 2022] DELETE /identity/v3/projects/be013053acfa448fa7549e6f70b915ab => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:19.822625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1a64-f479-4e21-8d45-4c3eff733253 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.822906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1a64-f479-4e21-8d45-4c3eff733253 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.823182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf1a64-f479-4e21-8d45-4c3eff733253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.855775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f5bf1a64-f479-4e21-8d45-4c3eff733253 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:19.857648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f5bf1a64-f479-4e21-8d45-4c3eff733253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.870288 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e77c-fcc4-4ece-9509-4774dd08c352 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:19.944481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:19.945177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.945391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.945662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.947415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:19.949138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1123/2241] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:19.957408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:19.957698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:19.957969 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:19.966264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:20.004534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:20.006116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:20.034885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1124/2242] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:20.039180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.049850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fd9a4-2f22-412d-a0ea-3a511cfab3c7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.055140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.055822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.056173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.056733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.057472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:20.058479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.060721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.060857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.062802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.074937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1119/2243] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:20.103152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1125/2244] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:20.105333 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.139180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3989a74-d138-47d0-8b4c-e51f8696cd88 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.151345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.152464 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.152936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.153345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.154407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.154949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.157282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:20.158947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.195885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea56e4e-a7f8-46cb-9552-fbaa749bbb6d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.214887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.215811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.216166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.216531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] PATH_INFO: `/v3/users/1b837ddd6aed46e0b3cb0fe2ced4087b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.221585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b837ddd6aed46e0b3cb0fe2ced4087b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.223631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.280846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1120/2245] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:20 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:20.286836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.334812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:20.360958 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b837ddd6aed46e0b3cb0fe2ced4087b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:20.383823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b837ddd6aed46e0b3cb0fe2ced4087b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:20.384948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b837ddd6aed46e0b3cb0fe2ced4087b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:20.385858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b837ddd6aed46e0b3cb0fe2ced4087b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:20.404133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b837ddd6aed46e0b3cb0fe2ced4087b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:20.449571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e671ea-2f79-4a6b-9bb7-54b41199d1ca admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.473791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1126/2246] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:20 2022] DELETE /identity/v3/users/1b837ddd6aed46e0b3cb0fe2ced4087b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:20.621964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.622817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.623279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.624022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.625019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.638124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.684758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1121/2247] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:20 2022] POST /identity/v3/users => generated 285 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:20.688974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.690726 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:20.719831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0438234-4dc5-43c7-8781-e4c5965504f2 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.740636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.740636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.740636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.740636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.742771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.748606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.782578 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1127/2248] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:20.783694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.797639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ede86-0cfa-4dde-917b-f3f026935277 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.810388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.811067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.811174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.811427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.812981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:20.814208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.815124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.819673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.851072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f34e0-2a86-4d0e-9a71-da8109eebaf7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.863389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.864044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.864328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.864625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] PATH_INFO: `/v3/projects/789463b8c5a64c5a95336941044dec5e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.866155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1122/2249] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:20.867987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789463b8c5a64c5a95336941044dec5e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.871171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:20.872302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:20.895235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df5ad-2263-41ec-a87b-5e045b3e808f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:20.905933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:20.909784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:20.913176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:20.913459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] PATH_INFO: `/v3/projects/7bd6045205ea4aefa685ec226c55848d/users/f68922690d8e47c3810a7366ab9a78b1/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:20.959170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd6045205ea4aefa685ec226c55848d, user_id=f68922690d8e47c3810a7366ab9a78b1, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:20.974785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ff7ad-cb0b-4b22-936d-3b0028638950 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:21.026284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1123/2250] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:20 2022] PUT /identity/v3/projects/7bd6045205ea4aefa685ec226c55848d/users/f68922690d8e47c3810a7366ab9a78b1/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:21.033110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:21.033534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:21.033815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:21.086127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789463b8c5a64c5a95336941044dec5e', 'request_id': 'req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.108596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789463b8c5a64c5a95336941044dec5e', 'request_id': 'req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.124758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789463b8c5a64c5a95336941044dec5e', 'request_id': 'req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.135164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] MFA Rules not processed for user `f68922690d8e47c3810a7366ab9a78b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:21.136469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:21.147169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] The token cache is being invalidate because project 789463b8c5a64c5a95336941044dec5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:21.147450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.148255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.151006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1128/2251] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:20 2022] DELETE /identity/v3/projects/789463b8c5a64c5a95336941044dec5e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:21.155845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:21.158380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:21.233265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:21.294266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42c96-99e9-4ed0-9711-9531f9d08dd5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:21.297994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1124/2252] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:21.303421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:21.304415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:21.304736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:21.305108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] PATH_INFO: `/v3/users/d7be2946cb3e43e7afc069841c872650` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:21.306966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7be2946cb3e43e7afc069841c872650)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:21.309507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:21.312985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:21.316687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:21.362512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:21.427048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7be2946cb3e43e7afc069841c872650'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.445354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7be2946cb3e43e7afc069841c872650'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.454770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7be2946cb3e43e7afc069841c872650'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.454770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7be2946cb3e43e7afc069841c872650'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.496690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-9edb393b-373e-439f-823e-1f089b55d6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7be2946cb3e43e7afc069841c872650'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:21.507424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d8a3-26b9-4743-9697-4109a59cd1dd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:21.520982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:21.521780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:21.523372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:21.523768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:21.529351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:21.539806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1129/2253] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:21 2022] DELETE /identity/v3/users/d7be2946cb3e43e7afc069841c872650 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:21.554766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:21.556467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:21.575865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1125/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:22.273406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384b2a-a75d-40bb-b731-06579cd8fa68 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:22.273948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384b2a-a75d-40bb-b731-06579cd8fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:22.274218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384b2a-a75d-40bb-b731-06579cd8fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:22.310965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-88384b2a-a75d-40bb-b731-06579cd8fa68 None None] MFA Rules not processed for user `f96b57f91667443c9ee3fdfd3cffeb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:22.312538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-88384b2a-a75d-40bb-b731-06579cd8fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:22.363100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:22.370497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:22.404054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a282a-6589-4681-925d-59d769654f74 service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:22.485609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1130/2255] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:22.584013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:22.584719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:22.585008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:22.585621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] PATH_INFO: `/v3/projects/1b8237ec79054ca1b87818e20b53f61c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:22.586853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8237ec79054ca1b87818e20b53f61c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:22.589133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:22.770963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8237ec79054ca1b87818e20b53f61c', 'request_id': 'req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:22.789676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8237ec79054ca1b87818e20b53f61c', 'request_id': 'req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:22.803049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8237ec79054ca1b87818e20b53f61c', 'request_id': 'req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:22.817853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] The token cache is being invalidate because project 1b8237ec79054ca1b87818e20b53f61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:22.818473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:22.819168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b09fe545-1cd6-4a9d-a2f2-881a9e77ad33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:22.823693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1126/2256] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:22 2022] DELETE /identity/v3/projects/1b8237ec79054ca1b87818e20b53f61c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:22.829133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:22.829598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:22.829818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:22.858866 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:22.860377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:22.920511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:22.944289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1131/2257] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:22.952845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448037c-c0c6-4f01-b6a1-9e7c0ba3e199 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:22.953165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448037c-c0c6-4f01-b6a1-9e7c0ba3e199 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:22.953386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448037c-c0c6-4f01-b6a1-9e7c0ba3e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:22.979552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c448037c-c0c6-4f01-b6a1-9e7c0ba3e199 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:22.980929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c448037c-c0c6-4f01-b6a1-9e7c0ba3e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:22.993438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1127/2258] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:22.998542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.018399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d69e7e-9a4f-4929-9158-46afd3d2ac21 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.035672 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.036313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.037997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.037997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.039456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:23.039904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.041783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.043735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.044122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.044538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.084765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1132/2259] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:23.084950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:23.084950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:23.085983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.104616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16d6d-1e4e-40e2-8839-41ebbde6272c admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.115920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.116664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.117030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.117584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.118311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.120470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.175449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1133/2260] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:23 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:23.180632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.184969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:23.260350 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1128/2261] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:02:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 07:02:23.270940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.280363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:23.392126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef0f7-cbf1-4f74-bba8-e284038e6a30 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.411328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.412765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.413492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.413921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.414718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.416822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.443399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afc8d-b7b1-4b07-aab1-49cf45dc0377 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.460274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1134/2262] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:23 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:23.464240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.477736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5237-fffa-449e-b12d-401f0fd0ec41 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.483730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.485090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.485363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.485636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.486328 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.488168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.503341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1135/2263] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:23.504537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.525820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304774-5fd8-4490-82c6-f930fcfc87eb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.532453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.533798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.534026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.534559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.535508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.537403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.555854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1136/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:23.556056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.556056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.556249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.556543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.557535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.575465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc7702-6fa8-4898-a6bb-12e9f2f2db13 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.582875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:23.584831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.585608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.585608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] PATH_INFO: `/v3/projects/fde049e6287940fca861a1611344bfb4/users/7d003316018d419e8ea372b94e2c29c1/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.608393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde049e6287940fca861a1611344bfb4, user_id=7d003316018d419e8ea372b94e2c29c1, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.611313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d6e2-7d9c-4b0a-ab47-f9850657da11 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.656596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:23.658857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:23.678399 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1137/2265] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:23 2022] PUT /identity/v3/projects/fde049e6287940fca861a1611344bfb4/users/7d003316018d419e8ea372b94e2c29c1/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:23.688481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1129/2266] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:02:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:23.690547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:23.690869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:23.691154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:23.755505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] MFA Rules not processed for user `7d003316018d419e8ea372b94e2c29c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:23.757624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:23.849458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:23.884374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1138/2267] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:23.885683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:23.904758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ebf7-2f50-4177-b23e-462b6d32c6b9 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:23.981482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:24.072941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.073633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.073951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.074526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.075439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.086859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.128933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.168705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1130/2268] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:23 2022] POST /identity/v3/projects => generated 375 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:24.181294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff2cb9-d67e-439b-87c9-43b04d1524cc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:24.311750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.312700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.313214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.313768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.315452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.317697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.357377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1139/2269] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:24 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:24.363195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.384152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93890df-f767-4fe7-a8af-65abe5ed2230 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:24.396040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.397306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.397893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.398436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.399357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.401894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.424932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1131/2270] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:24.425461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.445241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a7824-7018-456a-8b30-2a886f0e1080 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:24.463229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.464312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.464922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.465463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] PATH_INFO: `/v3/projects/a4c6be2b4db54f1a91ab085291bc0634/users/520fdbbe923943cb8c8b4fb1804d12eb/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.493255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c6be2b4db54f1a91ab085291bc0634, user_id=520fdbbe923943cb8c8b4fb1804d12eb, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.496766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.515871 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1140/2271] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:24 2022] PUT /identity/v3/projects/a4c6be2b4db54f1a91ab085291bc0634/users/520fdbbe923943cb8c8b4fb1804d12eb/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:24.521186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.540493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b545dc-8729-408d-b397-c1698285916a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:24.606906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.607818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.608116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.608395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.609125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.610866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5886d30-4710-4673-8af8-fe7f576676b1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.625074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1132/2272] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:24.629854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.647614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a8654-b7fa-4053-8f00-d4e718909ed2 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:24.666546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:24.667542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.667914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.668258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] PATH_INFO: `/v3/projects/a4c6be2b4db54f1a91ab085291bc0634/users/520fdbbe923943cb8c8b4fb1804d12eb/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.670565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c6be2b4db54f1a91ab085291bc0634, user_id=520fdbbe923943cb8c8b4fb1804d12eb, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:24.674327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:24.726420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1141/2273] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:24 2022] PUT /identity/v3/projects/a4c6be2b4db54f1a91ab085291bc0634/users/520fdbbe923943cb8c8b4fb1804d12eb/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:24.739183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:24.739501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:24.739739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:24.772094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] MFA Rules not processed for user `520fdbbe923943cb8c8b4fb1804d12eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:24.773461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:24.954306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1133/2274] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:24.965050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:24.969200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:25.117105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc9fb7-8d49-464b-988a-34bb59e818f0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:25.125050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:25.125384 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:25.125635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:25.127488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:25.250876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:25.255056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:25.258207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb82b2-ffc0-4690-bc9b-6979dd70fa5b service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:25.284710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1142/2275] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:28.237376 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:28.273915 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:28.325841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227bfe1-ee05-44f0-9fdc-bbfbc8e35cae None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:28.333736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:28.334784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:28.335323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:28.335604 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] PATH_INFO: `/v3/users/7d003316018d419e8ea372b94e2c29c1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:28.337495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d003316018d419e8ea372b94e2c29c1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:28.340156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:28.424059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d003316018d419e8ea372b94e2c29c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:28.436427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d003316018d419e8ea372b94e2c29c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:28.437487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d003316018d419e8ea372b94e2c29c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:28.438555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d003316018d419e8ea372b94e2c29c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:28.469803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d003316018d419e8ea372b94e2c29c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:28.495017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1134/2276] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:28 2022] DELETE /identity/v3/users/7d003316018d419e8ea372b94e2c29c1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:28.500242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:28.500745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:28.500876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:28.527804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:28.529857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:28.681660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1143/2277] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:28.714027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:28.715591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:28.846097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c3a2-ddb1-49a4-ac19-e63260ba8fdf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:28.852149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:28.853419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:28.853999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:28.854634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:28.875392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:28.878103 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:28.904748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1135/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:29.381585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:29.383563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:29.402189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d34ca7-df2c-4a26-9784-448311b9a991 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:29.407199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:29.408806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:29.409360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:29.409940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] PATH_INFO: `/v3/projects/fde049e6287940fca861a1611344bfb4` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:29.411970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde049e6287940fca861a1611344bfb4)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:29.414155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:29.484862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde049e6287940fca861a1611344bfb4', 'request_id': 'req-14481a4d-4822-4e0b-bb63-018e5a2da758'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.496485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde049e6287940fca861a1611344bfb4', 'request_id': 'req-14481a4d-4822-4e0b-bb63-018e5a2da758'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.506905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde049e6287940fca861a1611344bfb4', 'request_id': 'req-14481a4d-4822-4e0b-bb63-018e5a2da758'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.528644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] The token cache is being invalidate because project fde049e6287940fca861a1611344bfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:29.529273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.530370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-14481a4d-4822-4e0b-bb63-018e5a2da758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.533995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1144/2279] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:29 2022] DELETE /identity/v3/projects/fde049e6287940fca861a1611344bfb4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:29.538668 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:29.564998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed26a32-ade3-46db-90e7-6749bfaf0cfa service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:29.640421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:29.660497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:29.661365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:29.661645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:29.661938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] PATH_INFO: `/v3/users/520fdbbe923943cb8c8b4fb1804d12eb` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:29.663534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520fdbbe923943cb8c8b4fb1804d12eb)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:29.665864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:29.735182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520fdbbe923943cb8c8b4fb1804d12eb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.747033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520fdbbe923943cb8c8b4fb1804d12eb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.747950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520fdbbe923943cb8c8b4fb1804d12eb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.748608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520fdbbe923943cb8c8b4fb1804d12eb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.764490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520fdbbe923943cb8c8b4fb1804d12eb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:29.787269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1136/2280] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:29 2022] DELETE /identity/v3/users/520fdbbe923943cb8c8b4fb1804d12eb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:30.443009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663099-664d-4f64-8564-cc8f5effa7d0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.444235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663099-664d-4f64-8564-cc8f5effa7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.444763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d663099-664d-4f64-8564-cc8f5effa7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.479014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:30.481113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:30.483037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6d663099-664d-4f64-8564-cc8f5effa7d0 None None] MFA Rules not processed for user `c28a4cfa6f3d4d43b949931468ccb4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:30.485313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6d663099-664d-4f64-8564-cc8f5effa7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:30.596978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1145/2281] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:30.599666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846cfaf-4de0-408a-82ac-2bfc611902e8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:30.605686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:30.606642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.607139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.607746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] PATH_INFO: `/v3/projects/a4c6be2b4db54f1a91ab085291bc0634` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.609182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c6be2b4db54f1a91ab085291bc0634)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:30.611990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:30.673271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c6be2b4db54f1a91ab085291bc0634', 'request_id': 'req-05316b3a-ea22-4916-a2de-adf3f1562ff3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:30.681002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c6be2b4db54f1a91ab085291bc0634', 'request_id': 'req-05316b3a-ea22-4916-a2de-adf3f1562ff3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:30.690062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c6be2b4db54f1a91ab085291bc0634', 'request_id': 'req-05316b3a-ea22-4916-a2de-adf3f1562ff3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:30.695022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:30.705444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] The token cache is being invalidate because project a4c6be2b4db54f1a91ab085291bc0634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:30.707924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:30.708773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-05316b3a-ea22-4916-a2de-adf3f1562ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:30.711152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1137/2282] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:30 2022] DELETE /identity/v3/projects/a4c6be2b4db54f1a91ab085291bc0634 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:30.716411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.717208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.717838 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.744170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:30.745626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:30.770313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:30.817107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1146/2283] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:30.825122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.825405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.825732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.848164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:30.849472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:30.858077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1138/2284] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:30.863224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:30.874548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c11f-1817-4786-a6c6-fd3a7c30f6fc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:30.880034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:30.880810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.881138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.881408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.882182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:30.882531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:30.884449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:30.897835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1147/2285] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:02:30.902014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:30.914395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e3568-2bde-42d7-9e80-34ee9cecea5b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:30.919294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:30.919916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:30.920213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:30.920485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:30.921177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:30.923168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:30.959055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1139/2286] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:30 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:30.963255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:30.974327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4230b7-f70b-44f6-92da-15534c577468 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:31.069868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:31.070694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.071076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.071411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.072055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:31.074046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:31.108136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1148/2287] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:30 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:31.112254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:31.123548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8cb26-c9a1-4a9a-8ec9-e83a6026f604 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:31.128925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:31.129728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.130011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.130281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.131008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:31.132947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:31.145413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1140/2288] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:31.149771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:31.163160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c507d8-02bb-4c2e-a6bd-0a21327a3784 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:31.168216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:31.168915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.169191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.169583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.170256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:31.171975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a570ab3-66a4-42dc-bcd9-0c886b45a4dc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:31.190243 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1149/2289] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:31.191387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:31.202645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485c43e-36a9-4475-8cf1-2e293a1ade15 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:31.208038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:31.208892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.209272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.209578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] PATH_INFO: `/v3/projects/2a7ce723332f4a52a96969c3984dc911/users/d7249383ec8e42a79b73f05e3a6ff0b9/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.225389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7ce723332f4a52a96969c3984dc911, user_id=d7249383ec8e42a79b73f05e3a6ff0b9, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:31.228402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:31.243630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1141/2290] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:31 2022] PUT /identity/v3/projects/2a7ce723332f4a52a96969c3984dc911/users/d7249383ec8e42a79b73f05e3a6ff0b9/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:31.254598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.254903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.255182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.294763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] MFA Rules not processed for user `d7249383ec8e42a79b73f05e3a6ff0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:31.296158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:31.409837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1150/2291] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:31.421579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:31.426168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:31.521308 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654187-3697-45c9-be17-e36f801ab015 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:31.525309 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:31.526277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:31.526494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:31.526922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:31.542090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:31.543872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433aa85-c66f-4c74-9256-efa4e2aee274 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:31.557377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1142/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:41.405104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:41.551002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:43.603249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:43.683100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1dba5-427c-45e3-bd35-8ecd7e4069bc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:43.688787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:43.690109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:43.690109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:43.690109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] PATH_INFO: `/v3/users/d7249383ec8e42a79b73f05e3a6ff0b9` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:43.691684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7249383ec8e42a79b73f05e3a6ff0b9)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:43.693848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:43.779468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7249383ec8e42a79b73f05e3a6ff0b9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:43.797193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7249383ec8e42a79b73f05e3a6ff0b9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:43.798337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7249383ec8e42a79b73f05e3a6ff0b9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:43.799664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7249383ec8e42a79b73f05e3a6ff0b9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:43.817032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7249383ec8e42a79b73f05e3a6ff0b9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:43.891058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1151/2293] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:43 2022] DELETE /identity/v3/users/d7249383ec8e42a79b73f05e3a6ff0b9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:43.893891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fcb6d-73fb-4f42-83b2-87f55873504f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:43.894407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fcb6d-73fb-4f42-83b2-87f55873504f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:43.895639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fcb6d-73fb-4f42-83b2-87f55873504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:43.953777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a82fcb6d-73fb-4f42-83b2-87f55873504f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:43.955018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a82fcb6d-73fb-4f42-83b2-87f55873504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:44.138477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1143/2294] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:44.139931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:44.142693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:44.278986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c60f-6fa2-44c8-a0a7-72e23b072e34 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:44.283186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:44.284920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:44.284920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:44.284920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:44.296649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:44.298904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:44.311404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1152/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:44.419345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:44.419705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:44.420056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:44.444428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:44.446307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:44.558530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1144/2296] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:02:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:44.575106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:44.579036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:44.646396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:44.766590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c73ed-07be-415a-812c-dd92ac61d0ec service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:44.777208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:44.777750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:44.778094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:44.778301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:44.792247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:44.793981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e51cb-b856-4f00-8091-4c26489bd1f7 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:44.807719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1153/2297] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:02:45.767860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:45.770136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:45.803386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bd3c3-b5c4-4aad-b671-9430dfefac0f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:45.822078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:45.822998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:45.823436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:45.823874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] PATH_INFO: `/v3/projects/2a7ce723332f4a52a96969c3984dc911` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:45.829428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7ce723332f4a52a96969c3984dc911)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:45.832462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:45.946478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7ce723332f4a52a96969c3984dc911', 'request_id': 'req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:45.959737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7ce723332f4a52a96969c3984dc911', 'request_id': 'req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:45.981601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7ce723332f4a52a96969c3984dc911', 'request_id': 'req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:46.002588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] The token cache is being invalidate because project 2a7ce723332f4a52a96969c3984dc911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:46.003161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:46.013217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ef191c1-d495-4d4b-9c7a-c1c39f566aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:46.015395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1145/2298] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:45 2022] DELETE /identity/v3/projects/2a7ce723332f4a52a96969c3984dc911 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:46.027425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.027883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.027981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.074266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:46.077185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:46.234470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1154/2299] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:46.243871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.244205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.244439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.291043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:46.293061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:46.303511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1146/2300] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:46.308371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.324440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79b569-889b-45c9-a1fe-45b46c34d113 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.329842 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.330255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.330529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.330812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.331484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:46.331796 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.334281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:46.357657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.363976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1155/2301] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:46.370740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919069f-519b-4cc8-ba95-a56cc1d38264 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.377659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.378453 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.379368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.379778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.380801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.383077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:46.432261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:46.453319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1147/2302] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:46 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:46.459046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.563286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3d0d1-e984-4153-8504-b29352d0f19a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.698057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.698839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.699297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.699661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.700696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.702651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:46.767645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1156/2303] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:46 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:46.772985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.797811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406443-1309-4b92-b813-00b409e1d9df admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.812844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.813795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.814289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.814733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.815562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.817842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:46.840340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1148/2304] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:46.844501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.860689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b3970-e2c2-455b-901b-be79f8eb05a5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.876266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.879254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.880566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.881025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.882664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.886774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496a43-ab4d-423e-92ed-9969ae8691cd admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:46.909828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1157/2305] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:46.914680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:46.929616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40378618-39d2-4593-a645-550e4b84ca92 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:46.943734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:46.944413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:46.944897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:46.945354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] PATH_INFO: `/v3/projects/b995f32a179841f89d20d16e1b9f0a62/users/08a31034e6c7431fb519832442fa9b33/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:46.990167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b995f32a179841f89d20d16e1b9f0a62, user_id=08a31034e6c7431fb519832442fa9b33, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:46.993179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:47.031049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1149/2306] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:46 2022] PUT /identity/v3/projects/b995f32a179841f89d20d16e1b9f0a62/users/08a31034e6c7431fb519832442fa9b33/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:47.042191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:47.042809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:47.042809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:47.088459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] MFA Rules not processed for user `08a31034e6c7431fb519832442fa9b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:47.089837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:47.099655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:47.185566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1158/2307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:47.200994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:47.206361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:47.347182 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c2971-ebd1-4d65-98c4-010f1fcf949c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:47.368178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:47.369078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:47.369362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:47.369656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:47.395092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:47.402571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927e80d-b317-4c2a-b058-d0ebfcc51a46 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:47.442658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1150/2308] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:52.052247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:52.173918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b7b93-bc66-4ff1-816e-e6de589eeab7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:52.189548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:52.190262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:52.190548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:52.190823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] PATH_INFO: `/v3/users/08a31034e6c7431fb519832442fa9b33` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:52.196320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a31034e6c7431fb519832442fa9b33)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:52.200067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:52.295317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a31034e6c7431fb519832442fa9b33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:52.317117 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a31034e6c7431fb519832442fa9b33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:52.317745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a31034e6c7431fb519832442fa9b33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:52.318405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a31034e6c7431fb519832442fa9b33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:52.340992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a31034e6c7431fb519832442fa9b33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:52.387524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1159/2309] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:02:52 2022] DELETE /identity/v3/users/08a31034e6c7431fb519832442fa9b33 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:52.389076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:52.389942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:52.390238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:52.435141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:52.436280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:52.534714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1151/2310] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:52.541753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:52.543181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:52.608705 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:52.673475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad0f75-5045-4a18-b995-efa7b0c49a5d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:52.683867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:52.683867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:52.684781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:52.685104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:52.715006 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:52.716596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992196-f30b-4044-bb20-ec39b8aa06c0 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:52.745501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1160/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:53.457753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:53.459838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:53.498949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e12b2-9d2b-478c-81ef-cf686013520c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:53.510466 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:53.511553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:53.514133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:53.514579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] PATH_INFO: `/v3/projects/b995f32a179841f89d20d16e1b9f0a62` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:53.518596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b995f32a179841f89d20d16e1b9f0a62)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:53.524938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:53.625705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b995f32a179841f89d20d16e1b9f0a62', 'request_id': 'req-831f7cf3-17ce-4995-9561-83065c34bcb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:53.634620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b995f32a179841f89d20d16e1b9f0a62', 'request_id': 'req-831f7cf3-17ce-4995-9561-83065c34bcb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:53.681163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b995f32a179841f89d20d16e1b9f0a62', 'request_id': 'req-831f7cf3-17ce-4995-9561-83065c34bcb7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:53.696449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:53.730861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] The token cache is being invalidate because project b995f32a179841f89d20d16e1b9f0a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:02:53.731160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:53.732268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-831f7cf3-17ce-4995-9561-83065c34bcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:02:53.734066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1152/2312] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:02:53 2022] DELETE /identity/v3/projects/b995f32a179841f89d20d16e1b9f0a62 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:53.739173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:53.739739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:53.739913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:53.762337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:53.763678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:53.838737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1161/2313] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:53.846084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:53.846374 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:53.846652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:53.871200 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:53.872450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:53.889054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:53.900118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1153/2314] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:53.900352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1caa20-2f91-4ab5-87de-6d4a1dfea462 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:53.906461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:53.911460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:53.912991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:53.913270 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:53.915063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:02:53.915373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:53.917839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:53.938582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1162/2315] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:02:53.943251 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:53.953587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda07c6f-df89-447f-b9e0-244c9fa1a3f2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:53.970700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:53.971499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:53.972003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:53.972879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:53.973592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:53.976706 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.041805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1154/2316] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:53 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:54.046061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.061211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64d009-4476-46f3-8da0-6026b4509124 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.237463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.238197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.238473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.238730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.239550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.241414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.279427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1163/2317] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:54 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:54.284646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.299852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bdd88-9b51-4f28-a44c-86e4d8ec2f2d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.320665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.321201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.321686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.322130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.323229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.324990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.337937 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1155/2318] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:54.344647 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.362300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21336a-9014-4eda-8ea5-3c57d9042b88 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.379400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.380282 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.381172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.381521 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.382264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.384182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b0f4c-443f-44b7-bc8b-c3127888eb91 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.400546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1164/2319] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:54.406637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.434036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91902c6-bc25-449f-8d81-6228982bf6ec admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.438886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.439641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.439987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.440331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] PATH_INFO: `/v3/projects/b0b084208a4446d1af2c28bec2d46041/users/ddebb1c6b1ee468f83ee27b738a3c0f9/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.462624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b084208a4446d1af2c28bec2d46041, user_id=ddebb1c6b1ee468f83ee27b738a3c0f9, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.466432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.484368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1156/2320] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:54 2022] PUT /identity/v3/projects/b0b084208a4446d1af2c28bec2d46041/users/ddebb1c6b1ee468f83ee27b738a3c0f9/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:54.497589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.497761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.498004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.545936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] MFA Rules not processed for user `ddebb1c6b1ee468f83ee27b738a3c0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:54.547265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:54.582555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:54.646466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1165/2321] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:02:54.651680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.728467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bea7-4924-42c7-8ced-4ea9724e0767 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.736638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.736638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.736638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.736638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.737363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.738427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.769054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1157/2322] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:54 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:54.773712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.789664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393977bd-0cfe-459e-b22f-041e5310b43e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.853592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.854252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.855196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.855473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.858517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.860508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.886439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1166/2323] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:54 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:54.890840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.902849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de173ef1-70ad-472d-92ca-29046dbe0748 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.910656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.911285 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.912090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.912359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.913054 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.914812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.930903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1158/2324] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:54.934951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.951830 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d410c-bbd4-4b21-8a9a-238ab1eb116e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.957298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.958003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.958383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.958748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:54.959483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:54.962707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd455-f95a-44c5-821d-c75e431c151a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:54.973252 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1167/2325] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:54.977152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:54.988492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd3f7-e7cb-469d-a525-150c3342327c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:54.993484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:54.996718 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:54.997261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:54.997636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] PATH_INFO: `/v3/projects/44fc99caf69141439badbfb60d889154/users/734df63c8da941529dccd5739a5ebfac/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.028870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fc99caf69141439badbfb60d889154, user_id=734df63c8da941529dccd5739a5ebfac, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.031744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.047892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1159/2326] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:54 2022] PUT /identity/v3/projects/44fc99caf69141439badbfb60d889154/users/734df63c8da941529dccd5739a5ebfac/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:55.059008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.059298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.059567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.099215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] MFA Rules not processed for user `734df63c8da941529dccd5739a5ebfac`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:55.100788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:55.221688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1168/2327] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:55.223666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.324860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:55.365869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368edd-3a89-42b9-b55f-38ccb940ee22 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.375665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.376303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.376598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.377029 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.377679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.380478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.444312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1160/2328] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:02:55 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:02:55.448558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.467301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dbf54-0406-4203-ba5e-eaaeec6f0a1c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.551884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:55.603118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.604254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.604897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.605699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.606857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.609172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.646293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1169/2329] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:02:55 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:02:55.650415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.663355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b44ca7-721d-45ed-b0f3-67d0dbb804ad admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.674557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.675195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.675996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.678888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.679645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.682377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.703309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.711725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1161/2330] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:02:55.714543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5277-5d38-4a56-814c-0099850b5bdc admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.719766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.720453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.720773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.721042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] PATH_INFO: `/v3/projects/36d56452f41a44319ee1a4f136703ed0/users/3de94f9570ad4800a340ba1bb566842f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.738791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d56452f41a44319ee1a4f136703ed0, user_id=3de94f9570ad4800a340ba1bb566842f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.741608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.765045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.765471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1170/2331] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:55 2022] PUT /identity/v3/projects/36d56452f41a44319ee1a4f136703ed0/users/3de94f9570ad4800a340ba1bb566842f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:02:55.775799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0fc4-d56f-4c53-b1eb-e0090761b9b9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.844151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.844698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.844975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.845241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.845879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.847574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e1d45-036a-4846-a052-cf8fd0dcf51b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.858707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1162/2332] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:02:55.862667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:55.874018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb045e-fb86-470c-a781-7eb93567b25f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:55.878893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:55.879579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.879855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.880125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] PATH_INFO: `/v3/projects/36d56452f41a44319ee1a4f136703ed0/users/3de94f9570ad4800a340ba1bb566842f/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.882054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d56452f41a44319ee1a4f136703ed0, user_id=3de94f9570ad4800a340ba1bb566842f, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:55.884766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:55.896829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1171/2333] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:02:55 2022] PUT /identity/v3/projects/36d56452f41a44319ee1a4f136703ed0/users/3de94f9570ad4800a340ba1bb566842f/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:02:55.967108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:55.967457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:55.968419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:55.999351 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] MFA Rules not processed for user `3de94f9570ad4800a340ba1bb566842f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:56.001201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:56.102215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1163/2334] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:02:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:56.109550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:56.111356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:56.189439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc7383-2503-4fe5-9a0d-f53b25926857 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:56.193651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:56.194314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:56.194591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:56.194987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:56.277316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:56.278753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:56.289338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1172/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:58.140525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:58.158298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b72e79-6109-47af-b747-ed1d8b452fa1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:58.162710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:58.163321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:58.163599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:58.163872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:58.201980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:58.236296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:58.238342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209cfb-7352-4ed4-a50f-4497c6e948a3 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:58.248125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1164/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:58.968473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:58.977105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf411f8a-d3d5-4df8-9e00-b9f4c001b2f1 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:58.981467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:58.982065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:58.982343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:58.982665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:58.992262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:58.993801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:59.003066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1173/2337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:02:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:02:59.619339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:59.619807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:59.619914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:59.639483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:02:59.640715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:59.695515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1165/2338] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:02:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:02:59.708148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:02:59.709561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:02:59.742445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:02:59.782714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890e6e-e9a5-4705-8081-da980e0036f1 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:02:59.788188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:02:59.788880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:02:59.789284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:02:59.789596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:02:59.797956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:02:59.799623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:02:59.808714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1174/2339] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:02:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:03:01.902416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:01.917255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:02.022117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949b9ca-5c07-4936-a6e8-732c14333df8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.027787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.028093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.028366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.028684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] PATH_INFO: `/v3/users/914b572d048f4f7ca4587d97e0a42f01` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.029832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=914b572d048f4f7ca4587d97e0a42f01)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.031811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.083035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914b572d048f4f7ca4587d97e0a42f01'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.091227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914b572d048f4f7ca4587d97e0a42f01'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.091846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914b572d048f4f7ca4587d97e0a42f01'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.092469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914b572d048f4f7ca4587d97e0a42f01'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.105628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d4fd254-5d76-4aab-9a8f-0c03ebffaf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914b572d048f4f7ca4587d97e0a42f01'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.111713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:02.121511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1166/2340] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:01 2022] DELETE /identity/v3/users/914b572d048f4f7ca4587d97e0a42f01 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:02.320181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.333725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fc21e-13a6-4684-9a65-6a86c8e9f493 service swift] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.390925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.391552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.391833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.392108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] PATH_INFO: `/v3/projects/b92d76261a1f42cb8956f61f7a39ff92` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.393236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92d76261a1f42cb8956f61f7a39ff92)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.395713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.443784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92d76261a1f42cb8956f61f7a39ff92', 'request_id': 'req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.450449 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92d76261a1f42cb8956f61f7a39ff92', 'request_id': 'req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.455898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92d76261a1f42cb8956f61f7a39ff92', 'request_id': 'req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.467863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] The token cache is being invalidate because project b92d76261a1f42cb8956f61f7a39ff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:02.468171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.468937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d0153a0d-b9f4-4077-ba3e-b650ed2a3c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:02.470601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1175/2341] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:02 2022] DELETE /identity/v3/projects/b92d76261a1f42cb8956f61f7a39ff92 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:02.477283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.477653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.477932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.498979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:02.500165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:02.570659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1167/2342] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:02.578280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.578503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.578781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.599315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:02.600525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:02.608304 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1176/2343] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:02.612411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.622857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e52c5-a2d5-4555-a7cb-37cb53b0a9bd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.627702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.628517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.629411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.629717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.630498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:03:02.630890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.632822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.645833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1168/2344] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:03:02.650286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.659768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cacc0-8d81-4713-901f-ad726f31f1c8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.665570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.666171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.666445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.666712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.667342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.669289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.708422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1177/2345] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:02 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:02.712808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.724393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50cb9-189c-4164-bc96-8ad11d48564f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.809579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.810283 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.810530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.811648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.812328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.815334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.850876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1169/2346] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:02 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:02.861515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.883507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284f720-50de-4b52-b4fe-663efa7edeaa admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.890021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.890656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.890971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.891250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.891909 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.893732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.906426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1178/2347] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:02.911340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.941740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c599-beb2-4ea1-849f-2fe11d28f027 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:02.951019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:02.951649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:02.951927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:02.952390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:02.953282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:02.955196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594cef5-aeef-45de-b773-e9494774f1d2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:02.981418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:02.989621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1170/2348] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:03:03.008392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c4f43-2e43-4903-94c3-1b93fee48ab9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:03.023042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:03.023661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.023935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.024353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] PATH_INFO: `/v3/projects/fbca9d8edf774d2990e9209792ccaa13/users/cbbfdb882def46f997facb1bb511bd71/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.052379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:03.101275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbca9d8edf774d2990e9209792ccaa13, user_id=cbbfdb882def46f997facb1bb511bd71, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:03.106467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:03.135407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1179/2349] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:02 2022] PUT /identity/v3/projects/fbca9d8edf774d2990e9209792ccaa13/users/cbbfdb882def46f997facb1bb511bd71/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:03.148729 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.160789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.161202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.168003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:03.180805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.224233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] MFA Rules not processed for user `cbbfdb882def46f997facb1bb511bd71`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:03.232253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.335937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef3e62-1430-4d31-bf97-8ff32ecd4a31 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:03.354685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:03.355571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.355989 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.356264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] PATH_INFO: `/v3/users/ddebb1c6b1ee468f83ee27b738a3c0f9` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.358256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddebb1c6b1ee468f83ee27b738a3c0f9)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:03.361478 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:03.385816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:03.412818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1171/2350] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:03.427519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:03.429487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.450136 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddebb1c6b1ee468f83ee27b738a3c0f9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:03.463353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddebb1c6b1ee468f83ee27b738a3c0f9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:03.464221 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddebb1c6b1ee468f83ee27b738a3c0f9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:03.465426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddebb1c6b1ee468f83ee27b738a3c0f9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:03.481263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6dde0f0b-35aa-4707-bfe8-102c1e5b0645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddebb1c6b1ee468f83ee27b738a3c0f9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:03.517324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1180/2351] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:03 2022] DELETE /identity/v3/users/ddebb1c6b1ee468f83ee27b738a3c0f9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:03.522021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.522314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.522601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.523606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b06ef-81fa-41bc-9e8f-ccf794f3bd94 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:03.548128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:03.549706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.587385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:03.587910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.588184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.588455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.590377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.625921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1181/2352] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:03.636653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:03.638005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:03.643002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:03.652973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:03.654982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:03.666769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1172/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:03.698250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b731f6-b089-409a-9b3a-6c026d7d16aa None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:03.702511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:03.703147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:03.703431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:03.703737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:03.719095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:03.720481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:03.731211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1182/2354] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:03:04.106392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:04.109075 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:04.151470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bb5e1-1c6b-4bcc-9130-132d45b01704 service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:04.157375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:04.158039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:04.158378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:04.158569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] PATH_INFO: `/v3/projects/b0b084208a4446d1af2c28bec2d46041` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:04.159745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b084208a4446d1af2c28bec2d46041)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:04.161865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:04.241971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b084208a4446d1af2c28bec2d46041', 'request_id': 'req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.262505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b084208a4446d1af2c28bec2d46041', 'request_id': 'req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.266275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:04.273493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b084208a4446d1af2c28bec2d46041', 'request_id': 'req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.296382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] The token cache is being invalidate because project b0b084208a4446d1af2c28bec2d46041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:04.296721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.297372 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.298867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1173/2355] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:04 2022] DELETE /identity/v3/projects/b0b084208a4446d1af2c28bec2d46041 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:04.304012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:04.315621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91525c4f-3be3-4c70-b814-c36d97f3171c service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:04.386152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:04.386867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:04.387214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:04.387552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] PATH_INFO: `/v3/users/734df63c8da941529dccd5739a5ebfac` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:04.388922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=734df63c8da941529dccd5739a5ebfac)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:04.390987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:04.463882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734df63c8da941529dccd5739a5ebfac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.474901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734df63c8da941529dccd5739a5ebfac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.475670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734df63c8da941529dccd5739a5ebfac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.476381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734df63c8da941529dccd5739a5ebfac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.499003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cb2f9717-99f0-4e76-a7e1-0b0c6ac6dd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734df63c8da941529dccd5739a5ebfac'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:04.526119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1183/2356] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:04 2022] DELETE /identity/v3/users/734df63c8da941529dccd5739a5ebfac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:04.910526 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:04.915352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:04.938316 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6c7da-c3a4-4ebb-b0c1-990c1083994b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:05.028340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:05.029213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.029623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.029894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] PATH_INFO: `/v3/projects/44fc99caf69141439badbfb60d889154` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.033659 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fc99caf69141439badbfb60d889154)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:05.036627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:05.072423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752adfb-655d-4b56-b458-fc797d729723 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.072757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752adfb-655d-4b56-b458-fc797d729723 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.074082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752adfb-655d-4b56-b458-fc797d729723 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.074438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1184/2357] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:03:05.081169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.081821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.082164 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.109334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:05.109744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fc99caf69141439badbfb60d889154', 'request_id': 'req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.110609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:05.121757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fc99caf69141439badbfb60d889154', 'request_id': 'req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.135269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fc99caf69141439badbfb60d889154', 'request_id': 'req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.147144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:05.147507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] The token cache is being invalidate because project 44fc99caf69141439badbfb60d889154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:05.147795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.148505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.150356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1174/2358] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:04 2022] DELETE /identity/v3/projects/44fc99caf69141439badbfb60d889154 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:05.154206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:05.155559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:05.207290 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1185/2359] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:03:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:05.227594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40ba90-eb20-469a-94b8-201c2b7dbfb1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:05.232211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:05.232889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.233162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.233430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] PATH_INFO: `/v3/users/3de94f9570ad4800a340ba1bb566842f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.234560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de94f9570ad4800a340ba1bb566842f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:05.236455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:05.253223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:05.287716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de94f9570ad4800a340ba1bb566842f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.300954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de94f9570ad4800a340ba1bb566842f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.300954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de94f9570ad4800a340ba1bb566842f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.300954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de94f9570ad4800a340ba1bb566842f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.310887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-59b2003c-a378-436b-ab9a-91928e0f342c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de94f9570ad4800a340ba1bb566842f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.323028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1175/2360] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:05 2022] DELETE /identity/v3/users/3de94f9570ad4800a340ba1bb566842f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:03:05.630976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:05.647445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2fb4-92d3-4f50-9e97-d6435b229d6d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:05.718360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:05.719007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.719285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.719559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] PATH_INFO: `/v3/projects/36d56452f41a44319ee1a4f136703ed0` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.720704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d56452f41a44319ee1a4f136703ed0)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:05.722953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:05.781275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d56452f41a44319ee1a4f136703ed0', 'request_id': 'req-4d1e0332-788b-4bf5-98b9-3e6308c14286'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.789686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d56452f41a44319ee1a4f136703ed0', 'request_id': 'req-4d1e0332-788b-4bf5-98b9-3e6308c14286'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.795998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d56452f41a44319ee1a4f136703ed0', 'request_id': 'req-4d1e0332-788b-4bf5-98b9-3e6308c14286'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.811804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] The token cache is being invalidate because project 36d56452f41a44319ee1a4f136703ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:05.812122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.812820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4d1e0332-788b-4bf5-98b9-3e6308c14286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:05.814365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1186/2361] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:05 2022] DELETE /identity/v3/projects/36d56452f41a44319ee1a4f136703ed0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:05.819803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.820095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.820375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.840597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:05.841949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:05.907187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1176/2362] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:05.915864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.916146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.916453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.942161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:05.943450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:05.952695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1187/2363] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:05.956796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:05.982846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafca2a-4ea5-4fc1-aa7a-eee8a185e68c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:05.989644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:05.990360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:05.990703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:05.991057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:05.991770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:03:05.992139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:05.994153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.006531 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1177/2364] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:03:06.010857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.024385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d430-25fe-4ab9-8031-82ac9bd631f7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.032332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.036762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.037698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.038073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.038833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.041915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.076524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1188/2365] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:06 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:03:06.081065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.091575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440f4-f514-4909-9311-afee38c35bb1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.169546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.170425 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.170802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.172403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.173097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.175271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.205516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1178/2366] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:06 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:06.209577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.225431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746efd7-7a7e-48f4-8dfc-26b103ee28c4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.246289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.246921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.247201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.247473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.248134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.250536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.267004 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1189/2367] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:06.267980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.282808 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad98a-3e60-49bb-91c5-0866558ef282 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.311876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.312671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.313027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.313369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.314162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.316685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33214ed9-fd8a-418b-b1c0-46b590367dc8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.325619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:06.333819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1179/2368] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:03:06.337636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.357850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b88fdd-3f90-43ea-928e-2738ca2bf79e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.369797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.371623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.371987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.376316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] PATH_INFO: `/v3/projects/25d2cc1d03524169bbf1f71fa6e7379f/users/f4131d28bc59459dadff1f98a91991ae/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.381792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:06.403037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d2cc1d03524169bbf1f71fa6e7379f, user_id=f4131d28bc59459dadff1f98a91991ae, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.417469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.453465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1190/2369] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:06 2022] PUT /identity/v3/projects/25d2cc1d03524169bbf1f71fa6e7379f/users/f4131d28bc59459dadff1f98a91991ae/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:06.455353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.455744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.456149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.498074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] MFA Rules not processed for user `f4131d28bc59459dadff1f98a91991ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:06.500085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:06.581235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1180/2370] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:06.593127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.594810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:06.653036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd2a79-4543-4240-9335-54983d1c86e7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.656929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.657693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.657970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.658241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.670366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.671728 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed94a4-ec2a-4d46-8392-3f87dd7baac2 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.681536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1191/2371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:06.707714 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.776174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2007b-7117-40f8-bb40-5a09733fcd66 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:06.780807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:06.781461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.781735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.782004 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] PATH_INFO: `/v3/users/f4131d28bc59459dadff1f98a91991ae` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.783156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4131d28bc59459dadff1f98a91991ae)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:06.785242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:06.844786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4131d28bc59459dadff1f98a91991ae'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:06.854440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4131d28bc59459dadff1f98a91991ae'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:06.855323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4131d28bc59459dadff1f98a91991ae'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:06.855925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4131d28bc59459dadff1f98a91991ae'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:06.872241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4131d28bc59459dadff1f98a91991ae'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:06.886897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1181/2372] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:06 2022] DELETE /identity/v3/users/f4131d28bc59459dadff1f98a91991ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:06.891495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:06.891827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:06.892043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:06.912907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:06.914131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:06.987024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1192/2373] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:06.994997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:06.996470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:07.008490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:07.091269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79c532-df22-4260-af37-54e57c361fca admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:07.095073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:07.095693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:07.096057 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:07.096326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:07.107068 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:07.108822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:07.120914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1182/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:07.511982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:07.513707 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:07.552456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4789-c7f8-4283-bc29-4ff7beedface None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:07.569516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:07.570182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:07.573147 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:07.573496 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] PATH_INFO: `/v3/projects/25d2cc1d03524169bbf1f71fa6e7379f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:07.581300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d2cc1d03524169bbf1f71fa6e7379f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:07.585053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:07.682783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d2cc1d03524169bbf1f71fa6e7379f', 'request_id': 'req-4f3803a3-9c18-4867-9a04-60f1a1953cf9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:07.695580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d2cc1d03524169bbf1f71fa6e7379f', 'request_id': 'req-4f3803a3-9c18-4867-9a04-60f1a1953cf9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:07.704210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d2cc1d03524169bbf1f71fa6e7379f', 'request_id': 'req-4f3803a3-9c18-4867-9a04-60f1a1953cf9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:07.723317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] The token cache is being invalidate because project 25d2cc1d03524169bbf1f71fa6e7379f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:07.723860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:07.724811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:07.726555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1193/2375] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:07 2022] DELETE /identity/v3/projects/25d2cc1d03524169bbf1f71fa6e7379f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:12.241889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:12.243801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.258452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216804a-5095-4dcd-b054-ec7d7169a7c9 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:12.266569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:12.268104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.279736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:12.323302 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:12.324120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.324404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.324710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] PATH_INFO: `/v3/users/f68922690d8e47c3810a7366ab9a78b1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.325839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68922690d8e47c3810a7366ab9a78b1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:12.327918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:12.337014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3803a3-9c18-4867-9a04-60f1a1953cf9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:12.340624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:12.341229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.341502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.341770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.343523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.387527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68922690d8e47c3810a7366ab9a78b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:12.405093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68922690d8e47c3810a7366ab9a78b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:12.405839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68922690d8e47c3810a7366ab9a78b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:12.406498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68922690d8e47c3810a7366ab9a78b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:12.419449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b6e987fd-a65d-4649-9afe-0a6af4dd9745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68922690d8e47c3810a7366ab9a78b1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:12.426402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:12.427901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5769-a17a-403b-8798-70b7fa8005d2 service glance] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:12.433250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1183/2376] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:12 2022] DELETE /identity/v3/users/f68922690d8e47c3810a7366ab9a78b1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:12.437580 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.437938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.438218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.439820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1194/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:12.459203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:12.460993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.497903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:12.520712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852ef6-1635-4577-a421-7aae82dcfa85 None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.520903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852ef6-1635-4577-a421-7aae82dcfa85 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.521172 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc852ef6-1635-4577-a421-7aae82dcfa85 None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.523242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1195/2378] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 07:03:12.528013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.528522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.528812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.539652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1184/2379] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:12.549140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:12.549664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:12.550721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.550839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.605550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1196/2380] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:03:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:12.613120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4e14e-b651-4790-a846-ff6473e67b6e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:12.617760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:12.618458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.618738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.619052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.620351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:12.621759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.629197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:12.630618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223e24-db79-4345-b56c-0f4ab1887ee6 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:12.632332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae6b46-681e-4ec4-abc3-70e21628353d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:12.636021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:12.636643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.636921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.637186 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.640389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1185/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:03:12.644712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:12.646128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e16aa7-b07a-4208-81de-1a089134082f service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:12.654541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1197/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:03:12.748132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56fad-98cb-4bdd-82a7-4f51628f0b62 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.748523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56fad-98cb-4bdd-82a7-4f51628f0b62 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.749058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56fad-98cb-4bdd-82a7-4f51628f0b62 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.751234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1186/2383] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:03:12.758870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.759191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.759493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.782965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:12.784179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:12.841890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:12.873859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1198/2384] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:03:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:12.886032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56fad-98cb-4bdd-82a7-4f51628f0b62 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:12.902481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56fad-98cb-4bdd-82a7-4f51628f0b62 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:12.906444 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:12.907120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:12.907662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:12.907775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:12.921494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:12.922938 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6d4e3-1757-4c7c-9487-4c1d4d85acb2 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:12.935225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1187/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:13.028451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.030720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:13.055854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a79a45-abe3-4a59-a412-f0d7317fca69 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.061641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.062432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.062577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.062856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] PATH_INFO: `/v3/projects/7bd6045205ea4aefa685ec226c55848d` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.064108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd6045205ea4aefa685ec226c55848d)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.065954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.117869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd6045205ea4aefa685ec226c55848d', 'request_id': 'req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:13.125181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd6045205ea4aefa685ec226c55848d', 'request_id': 'req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:13.131850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd6045205ea4aefa685ec226c55848d', 'request_id': 'req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:13.144097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] The token cache is being invalidate because project 7bd6045205ea4aefa685ec226c55848d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:13.144386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:13.145107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6eb7ca8c-2f57-4c40-afc5-31568d5bcbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:13.146797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1199/2386] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:13 2022] DELETE /identity/v3/projects/7bd6045205ea4aefa685ec226c55848d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:13.152387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.152727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.153094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.183048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:13.184450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:13.250276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1188/2387] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:13.258609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.258894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.259174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.279555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:13.280693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:13.288459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1200/2388] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:13.292669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.302268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989b05c-0ba1-4228-88dc-95f766d0c85d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.307608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.308206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.308479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.308785 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.309442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:03:13.309731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.311323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.324295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1189/2389] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:03:13.329125 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.345364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b3838-4b95-42ab-8eb7-78b6bdf08cf9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.351337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.351713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.351988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.352284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.353139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.355030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.381560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1201/2390] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:13.386564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.396979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa721e-191a-49a3-b484-3b966be1363b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.467099 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:13.479875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.480489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.480835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.481109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.481751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.483658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.508145 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1190/2391] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:13 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:13.509576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.520307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc9263-b810-47f1-8bf0-6aedf4102ca5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.526695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.527360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.527824 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.528031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.528784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.530579 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.541120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1202/2392] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:13.544867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.557396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920ad1-bd4c-49e1-894b-926b3e6e1b93 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.562823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.563542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.563932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.564298 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.564988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.566594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d04432-eaea-4086-a2f2-ac2065967851 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.578082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1191/2393] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:13.582244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.592766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d874aa-8c67-4d68-8972-bbb8e924a786 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.598455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.599178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.599461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.599817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] PATH_INFO: `/v3/projects/746a26a24980431791b7b879efbc4525/users/0e31cd80142942829b4f0c2fe9fb590b/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.616534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746a26a24980431791b7b879efbc4525, user_id=0e31cd80142942829b4f0c2fe9fb590b, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.619876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.634408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1203/2394] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:13 2022] PUT /identity/v3/projects/746a26a24980431791b7b879efbc4525/users/0e31cd80142942829b4f0c2fe9fb590b/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:13.644519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d4b98-cb60-4b64-aee2-85af2dad0fed None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.645086 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d4b98-cb60-4b64-aee2-85af2dad0fed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.645358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d4b98-cb60-4b64-aee2-85af2dad0fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.674616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-745d4b98-cb60-4b64-aee2-85af2dad0fed None None] MFA Rules not processed for user `0e31cd80142942829b4f0c2fe9fb590b`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:13.675819 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-745d4b98-cb60-4b64-aee2-85af2dad0fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:13.739281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1192/2395] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:13.750730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:13.752499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:13.815477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714839-7d93-4adc-ab69-e83d54393797 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:13.819851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:13.821027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:13.821306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:13.821576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:13.829719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:13.831163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:13.836233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:13.841307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1204/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:15.729653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:15.730168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:15.730168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:15.749225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:15.750410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:15.806189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1193/2397] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:03:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:15.818116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:15.820789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:15.889954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143314-dda5-4664-b621-9a1b2bdc552f service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:15.895248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:15.895850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:15.896129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:15.896391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:15.904795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:15.906381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b97d-2db3-4314-b591-0a43030f80e8 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:15.914892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1205/2398] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:03:24.834554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:24.895407 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4811-6520-4218-b9eb-3e7b28f24427 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:24.900290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:24.900982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:24.901255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:24.901520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] PATH_INFO: `/v3/users/0e31cd80142942829b4f0c2fe9fb590b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:24.902622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e31cd80142942829b4f0c2fe9fb590b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:24.904529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:24.906881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:24.952628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e31cd80142942829b4f0c2fe9fb590b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:24.959494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e31cd80142942829b4f0c2fe9fb590b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:24.960172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e31cd80142942829b4f0c2fe9fb590b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:24.960831 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e31cd80142942829b4f0c2fe9fb590b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:24.973023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e31cd80142942829b4f0c2fe9fb590b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:24.985448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1194/2399] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:24 2022] DELETE /identity/v3/users/0e31cd80142942829b4f0c2fe9fb590b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:24.990257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:24.991290 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:24.991761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.013288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:25.014501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:25.075656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1206/2400] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:25.085866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.087304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:25.145342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ea05-9d93-49a5-a71f-3b8105b41bd0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.149368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.149971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.150247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.150516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.159299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.160763 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221cf2-e16c-48aa-8b4e-a8662f9ea63a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.171067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1195/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:25.476863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.478281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:25.490370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14ba1a-ba82-42b9-986a-b3acc50b8cac None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.498846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.499485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.499760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.500033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] PATH_INFO: `/v3/projects/746a26a24980431791b7b879efbc4525` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.501181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] RBAC: Authorizing `identity:delete_project(project_id=746a26a24980431791b7b879efbc4525)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.503115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.552089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746a26a24980431791b7b879efbc4525', 'request_id': 'req-95eb7bb7-9ba7-44fa-bb61-17546863311e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:25.560517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746a26a24980431791b7b879efbc4525', 'request_id': 'req-95eb7bb7-9ba7-44fa-bb61-17546863311e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:25.566055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746a26a24980431791b7b879efbc4525', 'request_id': 'req-95eb7bb7-9ba7-44fa-bb61-17546863311e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:25.578415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] The token cache is being invalidate because project 746a26a24980431791b7b879efbc4525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:25.578703 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:25.579345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-95eb7bb7-9ba7-44fa-bb61-17546863311e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:25.580977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1207/2402] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:25 2022] DELETE /identity/v3/projects/746a26a24980431791b7b879efbc4525 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:25.586717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.586993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.587269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.608711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:25.609907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:25.674889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1196/2403] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:25.685523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.685808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.686081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.705907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:25.707102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:25.715944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1208/2404] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:25.720153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.730492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53401d18-d76d-4b81-aced-49237b44db9c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.735134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.735726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.736003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.736272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.736956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:03:25.737258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.738853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.750185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1197/2405] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:03:25.754507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.764512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc8852-30ea-40da-8bc5-cf05fde9202b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.769311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.769913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.770190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.770459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.771114 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.774170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.779402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:25.809862 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1209/2406] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:25 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:25.813925 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.824105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8defaa8-e091-4fbf-82df-24728e20d5f0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.831942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:25.884597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.885299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.885643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.885978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.886645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.888598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.910341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1198/2407] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:25 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:25.915799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.926740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23470fbb-6bcc-466b-a14d-363457638fac admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.933141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.933756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.934145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.935016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.935507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.937209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.948376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1210/2408] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:25.952660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:25.964748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ae15-72e9-4ef9-8e36-71a1ac5a3374 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:25.970061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:25.970314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:25.970593 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:25.971591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:25.972238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:25.973876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f3e2-379b-4f26-9524-ce0c99f1970e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:25.988719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1199/2409] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:25.989949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:26.000701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03178235-4859-43a9-b098-66a127e51327 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:26.005357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:26.006003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:26.006340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:26.006624 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] PATH_INFO: `/v3/projects/2195cf5d54f7427b85ab1d5af279d106/users/6077bf41bd6946eb8527bf13d896919e/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:26.021480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2195cf5d54f7427b85ab1d5af279d106, user_id=6077bf41bd6946eb8527bf13d896919e, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:26.024443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:26.037249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1211/2410] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:25 2022] PUT /identity/v3/projects/2195cf5d54f7427b85ab1d5af279d106/users/6077bf41bd6946eb8527bf13d896919e/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:03:26.043018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8e4d-9c1f-4fab-8513-f6a0e1af4b05 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:26.043194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8e4d-9c1f-4fab-8513-f6a0e1af4b05 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:26.043562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8e4d-9c1f-4fab-8513-f6a0e1af4b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:26.063353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0eeb8e4d-9c1f-4fab-8513-f6a0e1af4b05 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:26.064472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0eeb8e4d-9c1f-4fab-8513-f6a0e1af4b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:26.121629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1200/2411] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:26.131144 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:26.133089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:26.188538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd1bc-9134-4c2c-b6e1-daf25694456b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:26.192381 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:26.193039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:26.193315 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:26.193586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:26.203355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:26.204816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:26.214752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1212/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:31.527583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:31.528349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:31.528349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:31.624154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] MFA Rules not processed for user `6077bf41bd6946eb8527bf13d896919e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:31.625394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:31.693974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1201/2413] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:31.698741 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:31.708887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a5333-d000-4a2f-ba07-a138b044d979 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:31.714273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:31.714951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:31.715234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:31.715529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:31.716389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:31.718339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:31.747477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1213/2414] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:31 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:03:31.751511 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:31.762795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333f74-33b2-416c-87ce-4af97d2ec4c3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:31.780662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:31.832640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:31.833382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:31.833663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:31.833934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:31.835110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:31.837082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:31.863617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1202/2415] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:31 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:31.867918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:31.878759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0ed5c-f47f-4e13-a2f4-6cac7a6036b1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:31.884309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:31.885026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:31.885312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:31.885584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:31.886230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:31.887839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:31.900002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1214/2416] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:31.904389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:31.916394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7da24-c57f-498c-8301-8f2c11a5dae0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:31.923539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:31.924830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:31.925610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:31.926039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] PATH_INFO: `/v3/projects/197583e2ec86493985b2a9e6d19217d8/users/d39f2d0252884c77ba1b6ec2c97c96a9/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:31.947381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197583e2ec86493985b2a9e6d19217d8, user_id=d39f2d0252884c77ba1b6ec2c97c96a9, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:31.950039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:31.969607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1203/2417] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:31 2022] PUT /identity/v3/projects/197583e2ec86493985b2a9e6d19217d8/users/d39f2d0252884c77ba1b6ec2c97c96a9/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:31.971375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:31.983083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34117538-7f80-4d62-bfa1-2653b1faffed admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:32.069286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:32.070166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:32.070566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:32.070843 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:32.071505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:32.073139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22f7c-1cec-4734-9c29-abcdc534d5a7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:32.087996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1215/2418] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:32.091788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:32.128677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71821-b5c5-4c8b-b58b-7db0bac213b7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:32.133818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:32.134485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:32.134759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:32.135027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] PATH_INFO: `/v3/projects/197583e2ec86493985b2a9e6d19217d8/users/d39f2d0252884c77ba1b6ec2c97c96a9/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:32.136978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197583e2ec86493985b2a9e6d19217d8, user_id=d39f2d0252884c77ba1b6ec2c97c96a9, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:32.145461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:32.166488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1204/2419] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:32 2022] PUT /identity/v3/projects/197583e2ec86493985b2a9e6d19217d8/users/d39f2d0252884c77ba1b6ec2c97c96a9/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:33.227641 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:33.228192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:33.228192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:33.299963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:33.302352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:33.338402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:33.420268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1216/2420] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:03:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:33.440246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:33.442194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:33.595676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635aae2-f8b2-485d-98ea-07aa621c2015 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:33.606591 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:33.607601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:33.608128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:33.609227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:33.627203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:33.630638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9615c-de57-4051-b074-ef89b72a5db9 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:33.649671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1205/2421] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:03:34.781228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:34.784203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:34.985982 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeb2ae-6530-451a-87d9-c72317594db9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:34.993727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:34.994697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:34.995203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:34.996039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] PATH_INFO: `/v3/users/cbbfdb882def46f997facb1bb511bd71` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:34.997561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbfdb882def46f997facb1bb511bd71)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:35.000386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:35.110294 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbfdb882def46f997facb1bb511bd71'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:35.128353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbfdb882def46f997facb1bb511bd71'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:35.129160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbfdb882def46f997facb1bb511bd71'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:35.129861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbfdb882def46f997facb1bb511bd71'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:35.142595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbfdb882def46f997facb1bb511bd71'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:35.182781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1217/2422] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:03:34 2022] DELETE /identity/v3/users/cbbfdb882def46f997facb1bb511bd71 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:03:35.187202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:35.187734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:35.187734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:35.226957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:35.233247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:35.403378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1206/2423] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:35.452067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:35.453963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:35.544235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:35.606762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64cb-d8f4-406f-b483-c3d733dd8c34 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:35.619593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:35.620332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:35.620698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:35.620973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:35.631461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:35.634096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b83f-3145-4657-ac2d-6fefb4a6788b service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:35.645589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1218/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:36.251922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:36.254455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:36.265551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:36.278642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa11b-be11-48e0-b38d-2847acac387c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:36.317396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:36.328155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:36.329071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:36.329583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] PATH_INFO: `/v3/projects/fbca9d8edf774d2990e9209792ccaa13` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:36.337765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbca9d8edf774d2990e9209792ccaa13)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:36.343215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:36.449424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbca9d8edf774d2990e9209792ccaa13', 'request_id': 'req-10a684b1-63a0-42e4-adec-c86997221faf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:36.468242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbca9d8edf774d2990e9209792ccaa13', 'request_id': 'req-10a684b1-63a0-42e4-adec-c86997221faf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:36.492934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbca9d8edf774d2990e9209792ccaa13', 'request_id': 'req-10a684b1-63a0-42e4-adec-c86997221faf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:36.509359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] The token cache is being invalidate because project fbca9d8edf774d2990e9209792ccaa13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:03:36.509647 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:36.511250 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10a684b1-63a0-42e4-adec-c86997221faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:03:36.515504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1207/2425] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:03:36 2022] DELETE /identity/v3/projects/fbca9d8edf774d2990e9209792ccaa13 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:36.521377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:36.525600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:36.526590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:36.632206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:36.636360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:36.783774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1219/2426] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:36.792463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:36.792827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:36.792827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:36.838803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:36.840277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:36.850428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:36.855003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:36.867248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17ca7-37af-41e5-9b74-ce3a6769e8c7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:36.875100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:36.875733 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:36.876016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:36.876286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:36.876981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:03:36.877287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:36.878908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:36.900095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1220/2428] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:03:36.905290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:36.922871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeaa89-d7c3-4019-bff7-31c6214f83f1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:36.931597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:36.932243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:36.932520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:36.932820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:36.933510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:36.935389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.000704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1209/2429] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:03:36 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:37.005181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:37.034582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6370-4416-48fb-86e9-0583654d58e7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:37.152914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:37.153742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.154142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.154515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.155269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:37.158217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.190495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1221/2430] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:03:37 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:03:37.196217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:37.208708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36787-1936-4c68-9be6-bd26d1fdfe44 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:37.214494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:37.215125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.216022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.216022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.216304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:37.218097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.230680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1210/2431] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:37.234920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:37.247461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e207-3c09-4386-afd0-59c2f69e82ee admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:37.254560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:37.255568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.257995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.258497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.259524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:37.261583 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37714fb-8296-4af8-a9e4-78b4d4c75869 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.275586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1222/2432] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:03:37.279732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:37.306252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b0794-5504-4c39-a581-ec1f5de11052 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:37.315375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:37.316067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.316379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.316630 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] PATH_INFO: `/v3/projects/74e99e2e4dbb4a04bd40d18a1c558089/users/53ea5f75c0cb495f9cd7461d28673bf2/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.340640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e99e2e4dbb4a04bd40d18a1c558089, user_id=53ea5f75c0cb495f9cd7461d28673bf2, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:37.343745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.372682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1211/2433] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:03:37 2022] PUT /identity/v3/projects/74e99e2e4dbb4a04bd40d18a1c558089/users/53ea5f75c0cb495f9cd7461d28673bf2/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:03:37.379559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083306-ac09-478b-af0e-1fc6f8b91f77 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.380432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083306-ac09-478b-af0e-1fc6f8b91f77 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.381653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083306-ac09-478b-af0e-1fc6f8b91f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.419889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a1083306-ac09-478b-af0e-1fc6f8b91f77 None None] MFA Rules not processed for user `53ea5f75c0cb495f9cd7461d28673bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:37.421534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a1083306-ac09-478b-af0e-1fc6f8b91f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:37.476470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:37.516244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1223/2434] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:37.530013 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:37.532645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:37.623844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68cfc0-e960-4dca-b51e-c491723a601f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:37.629277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:37.630448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:37.630910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:37.632730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:37.644988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:37.647710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:37.660233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1212/2435] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:38.820473 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa585c5-824a-46c0-be03-d2b91bf66c68 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:38.821070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa585c5-824a-46c0-be03-d2b91bf66c68 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:38.821309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa585c5-824a-46c0-be03-d2b91bf66c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:38.852251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3fa585c5-824a-46c0-be03-d2b91bf66c68 None None] MFA Rules not processed for user `d39f2d0252884c77ba1b6ec2c97c96a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:38.853522 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3fa585c5-824a-46c0-be03-d2b91bf66c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:38.923902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1224/2436] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:38.936256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:38.937845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:38.970044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:39.011121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76422f-df3a-45fc-b171-45e2d039139e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:39.014876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd52d02c55ffa409d85cdbffa7c30e00d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:39.015492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:39.015774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:39.016100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:39.017912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:39.093424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:39.094979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:39.107721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1213/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:39.265410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:39.265698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:39.265971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:39.287943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:39.289600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:39.359533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1225/2438] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:03:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:39.374270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:39.375863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:39.482607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413254-fb51-4eb0-9389-89d4cbf8534b service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:39.495143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:39.495845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:39.496207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:39.496558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:39.505996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:39.507866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc0e1-04e6-42fb-9192-7384e1a2aab1 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:39.517710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1214/2439] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:03:40.690491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:40.692141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:40.779137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948515-0611-4d91-b68c-eb125fae903c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:40.783818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:40.785388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:40.785859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:40.786335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:40.789403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:40.859273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:40.926010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:40.927798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:40.950856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1226/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:49.513361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=69 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:50.393108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c1de-9ecb-4177-b08b-3191c67b5128 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:50.393391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c1de-9ecb-4177-b08b-3191c67b5128 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:50.393664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c1de-9ecb-4177-b08b-3191c67b5128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:50.413486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5835c1de-9ecb-4177-b08b-3191c67b5128 None None] MFA Rules not processed for user `6077bf41bd6946eb8527bf13d896919e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:50.414675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5835c1de-9ecb-4177-b08b-3191c67b5128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:50.421440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1215/2441] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:03:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:03:50.936178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=19 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:03:51.551578 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:51.554032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:51.621980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a408-c42d-4145-926b-46b01f1a8ab6 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:51.626935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:51.627544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:51.627825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:51.628105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:51.629899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:51.642410 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:51.644010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:51.655398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1227/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:03:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:03:53.149931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:53.151065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:53.151488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:53.194027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:03:53.195273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:03:53.207550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1216/2443] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:03:53.221363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:03:53.240899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fdeff-0ec6-45b4-adce-aeacb2754a9a service placement] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:03:53.248329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:03:53.249565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:03:53.250063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:03:53.250575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:03:53.262146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:03:53.264042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641a6da-deb4-4c58-a8b4-6aab64a1dbac service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:03:53.286513 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1228/2444] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:04:03.182664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:03.274863 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=38 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:11.181026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:04:11.245565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b203-1883-4ab3-abf6-3c04e00b1cbf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:04:11.251791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:04:11.252458 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:11.252783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:11.253070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] PATH_INFO: `/v3/users/53ea5f75c0cb495f9cd7461d28673bf2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:11.254168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ea5f75c0cb495f9cd7461d28673bf2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:04:11.256163 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:04:11.310545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ea5f75c0cb495f9cd7461d28673bf2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.319276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ea5f75c0cb495f9cd7461d28673bf2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.320008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ea5f75c0cb495f9cd7461d28673bf2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.320635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ea5f75c0cb495f9cd7461d28673bf2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.335233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ea5f75c0cb495f9cd7461d28673bf2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.348974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1217/2445] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:04:11 2022] DELETE /identity/v3/users/53ea5f75c0cb495f9cd7461d28673bf2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:04:11.353224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:11.353730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:11.353813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:11.374367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:04:11.375587 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:11.448068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1229/2446] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:04:11.457957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:04:11.459493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:11.525379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eccf2-fbf7-439c-a678-c7bf180d5ed5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:04:11.529392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:04:11.530794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:11.531090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:11.531366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:11.541111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:04:11.542549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:04:11.552401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1218/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:04:11.893226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:04:11.894675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:11.907283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f9db-b35b-48fa-aa87-074184c480e2 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:04:11.911976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:04:11.912640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:11.912921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:11.913191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] PATH_INFO: `/v3/projects/74e99e2e4dbb4a04bd40d18a1c558089` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:11.914305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e99e2e4dbb4a04bd40d18a1c558089)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:04:11.916204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:04:11.963220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e99e2e4dbb4a04bd40d18a1c558089', 'request_id': 'req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.970340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e99e2e4dbb4a04bd40d18a1c558089', 'request_id': 'req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.977306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e99e2e4dbb4a04bd40d18a1c558089', 'request_id': 'req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.989758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] The token cache is being invalidate because project 74e99e2e4dbb4a04bd40d18a1c558089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:04:11.990079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.990745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-51541d45-8b59-4c99-a4c0-140fa8a0ceb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:04:11.992234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1230/2448] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:04:11 2022] DELETE /identity/v3/projects/74e99e2e4dbb4a04bd40d18a1c558089 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:04:19.812069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:04:19.813970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:19.825969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301fc3e-65c4-4ed1-ac33-5e9b96933ddb service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:04:19.846324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:19.879428 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:04:19.880024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:19.880300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:19.880568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:19.882318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:19.945849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:04:19.947295 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcc54-26fa-48b1-8dbe-67abbda23d3b service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:04:19.959435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1219/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:04:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:04:21.986993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:26.719563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372d9f-79a0-41bf-88f1-95178fcdeb79 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:26.719563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372d9f-79a0-41bf-88f1-95178fcdeb79 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:26.719563 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed372d9f-79a0-41bf-88f1-95178fcdeb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:26.738086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ed372d9f-79a0-41bf-88f1-95178fcdeb79 None None] MFA Rules not processed for user `c28a4cfa6f3d4d43b949931468ccb4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:04:26.739530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ed372d9f-79a0-41bf-88f1-95178fcdeb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:26.796517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1231/2450] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:04:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:04:27.681263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:04:27.681846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:04:27.681846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:04:27.702533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] MFA Rules not processed for user `7e3a230224be4212aa18fe752a07bde2`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:04:27.704034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:04:27.760164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1220/2451] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:04:36.789712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=25 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:04:37.753277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=65 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:00.270553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:00.270553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:00.270553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:00.289064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] MFA Rules not processed for user `44aaf56f8bde416fab0bff2989d9c1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:00.290291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:00.348665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1232/2452] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:10.340836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=25 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:23.224394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:23.225881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:23.238312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5d8a-d8c8-429e-8ea9-cb62bf49d54b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:23.241878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:23.242469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:23.242746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:23.243014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:23.244675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:23.317742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:23.319092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:23.330794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1221/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:24.510278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:24.511680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:24.523827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8157f02-3068-488f-b094-538854bc3bc8 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:24.527476 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:24.528076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:24.528352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:24.528651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:24.530460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:24.543495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:24.545622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:24.556658 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1233/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:32.834366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:32.844244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7a4f-22f7-4383-ae09-4884305990d1 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:32.848256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:32.849014 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:32.849368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:32.849711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:32.851542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:32.921167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:32.922643 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:32.935232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1222/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:34.551585 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=6 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:36.308353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:36.309941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:36.324251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d3b4-864b-4ae0-be68-edbf41944a84 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:36.329735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:36.330335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.331131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.331131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] PATH_INFO: `/v3/users/c28a4cfa6f3d4d43b949931468ccb4ec` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.332313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28a4cfa6f3d4d43b949931468ccb4ec)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:36.334558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:36.383095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28a4cfa6f3d4d43b949931468ccb4ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.391279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28a4cfa6f3d4d43b949931468ccb4ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.392011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28a4cfa6f3d4d43b949931468ccb4ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.392760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28a4cfa6f3d4d43b949931468ccb4ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.399753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-82fb7b75-bd62-4c38-bd49-f3f2c1b0edca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28a4cfa6f3d4d43b949931468ccb4ec'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.417394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1234/2456] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:05:36 2022] DELETE /identity/v3/users/c28a4cfa6f3d4d43b949931468ccb4ec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:05:36.588457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:36.600456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f2f30-0ca6-438c-9c00-f21646bdc73e service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:36.673480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:36.674328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.674708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.675050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] PATH_INFO: `/v3/projects/d38ccf6c6a10447b9ed7247ab19b4f85` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.676191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38ccf6c6a10447b9ed7247ab19b4f85)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:36.678394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:36.702929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:36.735234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38ccf6c6a10447b9ed7247ab19b4f85', 'request_id': 'req-929659da-96fd-4daf-b947-eafe915bab78'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.744184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38ccf6c6a10447b9ed7247ab19b4f85', 'request_id': 'req-929659da-96fd-4daf-b947-eafe915bab78'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.756067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38ccf6c6a10447b9ed7247ab19b4f85', 'request_id': 'req-929659da-96fd-4daf-b947-eafe915bab78'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.774205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] The token cache is being invalidate because project d38ccf6c6a10447b9ed7247ab19b4f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:05:36.774205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.774881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-929659da-96fd-4daf-b947-eafe915bab78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:05:36.776484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1223/2457] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:05:36 2022] DELETE /identity/v3/projects/d38ccf6c6a10447b9ed7247ab19b4f85 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:05:36.782130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.782484 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.782822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.804313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:36.805594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:36.868354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1235/2458] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:36.876410 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.876739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.877018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.896603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:36.897810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:36.906297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1224/2459] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:36.910423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:36.920770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0e96-eeeb-410f-9e5f-735da37e9de7 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:36.925467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:36.926057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.926333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.926603 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.927250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:05:36.927561 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:36.929570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:36.941451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1236/2460] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:05:36.945875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:36.955209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943776ba-452b-4fd6-8227-7e2db87db4b6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:36.959821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:36.960421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:36.960817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:36.961087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:36.961717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:36.963609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:36.992868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1225/2461] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:05:36 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:05:36.997014 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:37.007621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4527366-702c-48eb-8332-114c868e4fd1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:37.065206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:37.065807 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.066085 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.066354 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.066967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:37.068903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:37.077770 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:37.094193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1237/2462] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:05:36 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:05:37.098391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:37.108908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413306e5-3850-4574-968f-7a5e63f17225 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:37.113505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:37.114089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.114361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.114626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.115284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:37.116894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:37.126878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1226/2463] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:05:37.130910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:37.141283 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1be0-2a8f-4312-a5c1-6c372c6afdfb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:37.145829 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:37.146411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.146683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.146950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.147580 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:37.149200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a357e-8476-4dbd-ad35-b7096e6d3adc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:37.160505 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1238/2464] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:05:37.164963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:37.176109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195011f9-694b-44b0-8b4e-e9d29aaca569 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:37.181575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:37.182358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.182637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.182903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] PATH_INFO: `/v3/projects/5011fce17cce4813b372c6d7982f4dd5/users/7ddba1ca7ae845ecb82b92e8035b9178/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.199160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5011fce17cce4813b372c6d7982f4dd5, user_id=7ddba1ca7ae845ecb82b92e8035b9178, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:37.202297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:37.222312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1227/2465] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:05:37 2022] PUT /identity/v3/projects/5011fce17cce4813b372c6d7982f4dd5/users/7ddba1ca7ae845ecb82b92e8035b9178/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:05:37.227206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.227498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.227771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.247577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:37.249737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:37.310555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1239/2466] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:37.320664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:37.322413 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:37.384212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fca2ce-0324-4a2f-bdf8-f8f4b89a1fd4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:37.387995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:37.388739 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:37.389020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:37.389287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:37.398939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:37.400355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c787-7cce-450c-8848-240a58045d76 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:37.410830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1228/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:40.246581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:40.248745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:40.340604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01422a5-faa9-41db-9169-3dc2bf914561 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:40.346280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:40.347021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:40.347407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:40.347771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:40.349693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:40.412454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:40.414078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:40.424654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1240/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:41.523890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e6b6-a05c-46f9-9aed-dd271d5e352b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:41.524419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e6b6-a05c-46f9-9aed-dd271d5e352b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:41.524419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e6b6-a05c-46f9-9aed-dd271d5e352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:41.587888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9983e6b6-a05c-46f9-9aed-dd271d5e352b None None] MFA Rules not processed for user `7ddba1ca7ae845ecb82b92e8035b9178`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:41.589204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9983e6b6-a05c-46f9-9aed-dd271d5e352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:41.634513 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:41.667696 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1229/2469] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:41.687834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:41.706087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5ccf-860a-433c-92da-70da2b499022 service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:41.713898 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:41.714659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:41.715042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:41.715412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:41.725350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:41.727340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:41.737999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1241/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:43.083289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839da8-b3e8-438b-9e6c-c795ff9dc340 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:43.083770 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839da8-b3e8-438b-9e6c-c795ff9dc340 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:43.084008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839da8-b3e8-438b-9e6c-c795ff9dc340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:43.112448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9f839da8-b3e8-438b-9e6c-c795ff9dc340 None None] MFA Rules not processed for user `7ddba1ca7ae845ecb82b92e8035b9178`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:43.113833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9f839da8-b3e8-438b-9e6c-c795ff9dc340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:43.124833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1230/2471] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:05:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:43.465748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:43.470595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:43.477533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942740-21e7-453b-a528-1a3209fa2ccf service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:43.485009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:43.485695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:43.486042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:43.486385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:43.488254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:43.499661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:43.501233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:43.510667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1242/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:43.653800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:43.654612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:43.655045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:43.676519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:05:43.677889 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:43.746073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1231/2473] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:05:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:05:43.802086 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:43.804092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:43.907251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d919c-5e8c-4d5e-b5eb-3f48d0a467e8 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:43.907566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:43.909037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:43.913670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:43.914434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:43.914760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:43.915047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:43.927600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:43.930012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:43.941850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1243/2474] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:05:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:05:44.098813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd52e-83e0-45fe-8752-fccb3e3f6815 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:44.111550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:44.111550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:44.111550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:44.111550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:44.112179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:44.144702 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:44.148164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:44.174926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1232/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:05:50.692841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:50.703628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119bc23-08d8-4e6f-a687-56fd06bacb30 service swift] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:50.709892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:50.710514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:50.710791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:50.711063 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:50.718642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:50.739371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:50.741763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:50.753540 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1244/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:54.155790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=70 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:05:57.434225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:57.435719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:57.451345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfab94-c162-4ec2-9949-58f9307ff7e2 service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:57.456811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:57.457409 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:57.457691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:57.457965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:57.459631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:57.519125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:57.520748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb54103-57e5-4878-9a86-8f52dc662b36 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:57.530798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1233/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:05:58.667203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:05:58.682774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fcca4-6359-4545-ad10-7883005eb2d9 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:05:58.689380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:05:58.690177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:05:58.690486 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:05:58.690936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:05:58.692939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:05:58.707358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:05:58.709081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:05:58.722350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1245/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:05:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:00.321676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:00.322160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:00.322252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:00.342903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:00.344211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:00.351228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1234/2479] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:00.364687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:00.378572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7e926-4ae7-4d2c-adb9-8ee5bdb3fe62 service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:00.383937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:00.384547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:00.384864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:00.385143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:00.394408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:00.397342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4acc2-5026-4520-b189-95646041a544 service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:00.410450 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1246/2480] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:04.748722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:04.750168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:04.765469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6ea09-bee3-4828-abc9-51f3e0dda7aa None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:04.769576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:04.771113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:04.771492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:04.771862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:04.776506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:04.803639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:04.805793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac82b-5057-43fb-9a79-c083bbccae0d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:04.819631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1235/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:07.409344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd8d-457e-406c-a331-a8774a84e25b None None] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.410464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd8d-457e-406c-a331-a8774a84e25b None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.411048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfd8d-457e-406c-a331-a8774a84e25b None None] PATH_INFO: `/` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.412883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1247/2482] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:06:07.424423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebea4e-20a5-4aec-847d-144e8fc373ce None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.425773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebea4e-20a5-4aec-847d-144e8fc373ce None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.426258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebea4e-20a5-4aec-847d-144e8fc373ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.461094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c2ebea4e-20a5-4aec-847d-144e8fc373ce None None] MFA Rules not processed for user `6619aa7d0347403ab596d1bfae72e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:07.462923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c2ebea4e-20a5-4aec-847d-144e8fc373ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:07.472484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1236/2483] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:06:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:07.489220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cfd8d-457e-406c-a331-a8774a84e25b None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:07.502938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cfd8d-457e-406c-a331-a8774a84e25b None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:07.506918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:07.507719 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.508149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.508569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.520271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:07.523636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddee67-0eb3-4940-a411-cc0b609d95bf service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:07.585954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1248/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:07.826468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4637-6ffa-4377-8ba9-527ae466b30e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.827162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4637-6ffa-4377-8ba9-527ae466b30e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.827607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d4637-6ffa-4377-8ba9-527ae466b30e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.829446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1237/2485] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 07:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 07:06:07.836788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d306-aef6-43b4-bd86-86a7451577e3 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.837698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d306-aef6-43b4-bd86-86a7451577e3 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.838155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d306-aef6-43b4-bd86-86a7451577e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.864828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2c73d306-aef6-43b4-bd86-86a7451577e3 None None] MFA Rules not processed for user `b732fb0cfa4749c3a1e96639ff69e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:07.866058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2c73d306-aef6-43b4-bd86-86a7451577e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:07.883102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1249/2486] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 07:06:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:07.894791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d4637-6ffa-4377-8ba9-527ae466b30e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:07.910188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d4637-6ffa-4377-8ba9-527ae466b30e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:07.913913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:07.914679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:07.914960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:07.915232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:07.926036 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:07.927465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:07.939180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1238/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:08.783928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:08.784435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:08.784533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:08.842481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:08.844468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:08.864885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1250/2488] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 07:06:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:08.884441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:08.903933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2569-32e2-4cb2-8cb0-24b72d9b6ce7 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:08.911606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:08.912394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:08.912873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:08.913319 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:08.925722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:08.927488 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:08.964229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1239/2489] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:09.912990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:09.935827 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f4ecf-1a68-4478-b3a3-204a4a087aab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:09.951546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:09.952612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:09.953077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:09.953503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:09.959894 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:10.013376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:10.023767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:10.068501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1251/2490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:06:10.125767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:10.127297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:10.146082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1141c-2810-4c1b-8868-d3e33e6a4422 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:10.150799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:10.151633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:10.152094 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:10.152537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] PATH_INFO: `/v3/users/6077bf41bd6946eb8527bf13d896919e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:10.154230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6077bf41bd6946eb8527bf13d896919e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:10.156348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:10.211387 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6077bf41bd6946eb8527bf13d896919e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.219492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6077bf41bd6946eb8527bf13d896919e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.220216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6077bf41bd6946eb8527bf13d896919e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.220949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6077bf41bd6946eb8527bf13d896919e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.234501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6077bf41bd6946eb8527bf13d896919e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.247205 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1240/2491] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:10 2022] DELETE /identity/v3/users/6077bf41bd6946eb8527bf13d896919e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:10.505322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:10.516469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5a713-9427-4f18-bc97-30b5f48f10a1 service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:10.573333 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:10.573967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:10.574250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:10.574524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] PATH_INFO: `/v3/projects/2195cf5d54f7427b85ab1d5af279d106` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:10.576219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2195cf5d54f7427b85ab1d5af279d106)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:10.578167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:10.579571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:10.624902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2195cf5d54f7427b85ab1d5af279d106', 'request_id': 'req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.632273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2195cf5d54f7427b85ab1d5af279d106', 'request_id': 'req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.639107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2195cf5d54f7427b85ab1d5af279d106', 'request_id': 'req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.650292 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] The token cache is being invalidate because project 2195cf5d54f7427b85ab1d5af279d106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:10.650584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.651251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.652786 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1252/2492] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:10 2022] DELETE /identity/v3/projects/2195cf5d54f7427b85ab1d5af279d106 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:10.657093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:10.658588 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:10.671586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b946df-9da1-4153-a994-d0a8c3d6ef84 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:10.686192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:10.798755 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:10.799478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:10.799756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:10.800116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] PATH_INFO: `/v3/users/d39f2d0252884c77ba1b6ec2c97c96a9` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:10.801514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39f2d0252884c77ba1b6ec2c97c96a9)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:10.804370 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:10.913562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39f2d0252884c77ba1b6ec2c97c96a9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.931388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39f2d0252884c77ba1b6ec2c97c96a9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.933312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39f2d0252884c77ba1b6ec2c97c96a9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.934403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39f2d0252884c77ba1b6ec2c97c96a9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.956323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-60623e89-5272-41f0-80f0-4573efb378cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39f2d0252884c77ba1b6ec2c97c96a9'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:10.988853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1241/2493] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:10 2022] DELETE /identity/v3/users/d39f2d0252884c77ba1b6ec2c97c96a9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:11.188173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:11.189659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:11.202231 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032888-ccd2-4b1a-81d8-6fe1eb3ae53d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:11.259067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:11.259698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:11.259973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:11.260242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] PATH_INFO: `/v3/projects/197583e2ec86493985b2a9e6d19217d8` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:11.261367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=197583e2ec86493985b2a9e6d19217d8)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:11.263330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:11.308439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197583e2ec86493985b2a9e6d19217d8', 'request_id': 'req-08bbe16a-95a1-42ac-b10e-4b5582640b0b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:11.315800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197583e2ec86493985b2a9e6d19217d8', 'request_id': 'req-08bbe16a-95a1-42ac-b10e-4b5582640b0b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:11.321492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197583e2ec86493985b2a9e6d19217d8', 'request_id': 'req-08bbe16a-95a1-42ac-b10e-4b5582640b0b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:11.332510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] The token cache is being invalidate because project 197583e2ec86493985b2a9e6d19217d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:11.332831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:11.333463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:11.335098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1253/2494] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:11 2022] DELETE /identity/v3/projects/197583e2ec86493985b2a9e6d19217d8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:20.976237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:21.329545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:28.373392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:28.374382 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:28.374741 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:28.397421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] MFA Rules not processed for user `5478fe7a36ca488e97019de5ae467f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:28.399217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:28.471420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1242/2495] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 07:06:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:28.488355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:28.489844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:28.562146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe16a-95a1-42ac-b10e-4b5582640b0b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:28.568257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421252e103f1435286c0f3b84442c6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:28.568896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:28.569178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:28.569445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:28.577575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:28.579879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:28.588151 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1254/2496] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 07:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 07:06:34.586003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:34.587487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:34.642807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3b9b-e611-4606-adc0-ac2620318bbb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:34.646367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:34.646957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:34.647230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:34.647497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:34.649216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:34.710459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:34.711872 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:34.721412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1243/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:38.045617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.047235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:38.062396 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140da36-47fb-40a3-9e55-c705a84c2fcf service swift] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.067659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.068279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.068554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.068854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] PATH_INFO: `/v3/users/44aaf56f8bde416fab0bff2989d9c1a2` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.070197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aaf56f8bde416fab0bff2989d9c1a2)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.072261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.117810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aaf56f8bde416fab0bff2989d9c1a2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.126881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aaf56f8bde416fab0bff2989d9c1a2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.127694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aaf56f8bde416fab0bff2989d9c1a2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.128306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aaf56f8bde416fab0bff2989d9c1a2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.135570 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8f3cf80b-c774-417e-bdb4-655f3eb72d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aaf56f8bde416fab0bff2989d9c1a2'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.153436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1255/2498] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:38 2022] DELETE /identity/v3/users/44aaf56f8bde416fab0bff2989d9c1a2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:38.319368 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.330206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d66f11-0bf8-4ebd-8d19-74ff59dd637d service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.385168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:38.395356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.396206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.396560 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.396959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] PATH_INFO: `/v3/projects/91a66973ccb646f4b92203c9a3f910ac` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.398113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a66973ccb646f4b92203c9a3f910ac)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.400034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.447825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a66973ccb646f4b92203c9a3f910ac', 'request_id': 'req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.454545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a66973ccb646f4b92203c9a3f910ac', 'request_id': 'req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.462001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a66973ccb646f4b92203c9a3f910ac', 'request_id': 'req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.473500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] The token cache is being invalidate because project 91a66973ccb646f4b92203c9a3f910ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:38.473784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.474495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-daea5d1a-db6e-4faa-acf6-3ec3751fab7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:38.476028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1244/2499] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:38 2022] DELETE /identity/v3/projects/91a66973ccb646f4b92203c9a3f910ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:38.480953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.481244 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.481518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.500744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:38.501945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:38.560831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1256/2500] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:38.569847 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.570131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.570406 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.591357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:38.592549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:38.601726 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1245/2501] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:38.606109 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.611536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:38.618420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f075-0f91-4294-ad0d-77db143d4f01 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.629495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.630129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.630407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.630679 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.631325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:06:38.631628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.633311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.645539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1257/2502] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:06:38.649865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.659312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14b0d-811b-47ac-b40d-cba99e9e2320 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.664031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.664652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.664935 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.665206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.665845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.667781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.699433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1246/2503] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:38 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:38.700537 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.711062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32871fa0-9c5d-4103-8b73-c5830201447a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.770689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.771309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.771614 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.771881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.772531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.774560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.801092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1258/2504] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:38 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:06:38.806180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.817957 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4985d2-c0d2-4eac-a87d-aaa6beef54dd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.822887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.823624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.823904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.824174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.824981 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.826733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.840640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1247/2505] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:38.843102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.854273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89395-ff7d-45cf-aab5-08b52752d72f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.859254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.859864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.861035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.861411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.862070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.863694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc725cdb-d2fb-4924-8045-ae9dc9e60375 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.881782 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1259/2506] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:38.882974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:38.894334 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a21d9-5659-485b-8514-ee1db9cde80d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:38.899002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:38.899653 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.899933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.900204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] PATH_INFO: `/v3/projects/525c72f32bff44ed874fed54e85105e7/users/4ba6b792776447efb6ddbb95b41eeb43/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.917142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525c72f32bff44ed874fed54e85105e7, user_id=4ba6b792776447efb6ddbb95b41eeb43, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:38.919826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:38.935357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1248/2507] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:38 2022] PUT /identity/v3/projects/525c72f32bff44ed874fed54e85105e7/users/4ba6b792776447efb6ddbb95b41eeb43/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:38.946529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:38.946817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:38.947108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:38.975933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] MFA Rules not processed for user `4ba6b792776447efb6ddbb95b41eeb43`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:38.977181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:39.042875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1260/2508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:39.055270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:39.056990 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:39.133259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0b09-0973-42bd-88f6-b93953dc7b09 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:39.138679 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:39.139276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:39.139553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:39.139820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:39.148460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:39.150076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d6d2-5e6a-4ef6-a6cb-9133eaf08a92 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:39.159803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1249/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:39.368789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:39.426581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:39.430943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97700727-7cd9-4378-8bf8-18c95d63a1fe None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:39.437339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:39.438119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:39.438609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:39.438931 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] PATH_INFO: `/v3/users/4ba6b792776447efb6ddbb95b41eeb43` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:39.440377 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba6b792776447efb6ddbb95b41eeb43)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:39.442673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:39.490337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba6b792776447efb6ddbb95b41eeb43'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:39.498627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba6b792776447efb6ddbb95b41eeb43'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:39.499821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba6b792776447efb6ddbb95b41eeb43'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:39.501293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba6b792776447efb6ddbb95b41eeb43'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:39.510204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba6b792776447efb6ddbb95b41eeb43'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:39.527709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1261/2510] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:39 2022] DELETE /identity/v3/users/4ba6b792776447efb6ddbb95b41eeb43 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:39.532263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:39.532756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:39.532883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:39.545735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:39.551984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:39.553576 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:39.612132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1250/2511] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:39.622127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:39.623612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:39.683941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c970-5375-4d41-888c-58e46c21d48e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:39.687695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:39.688875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:39.689154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:39.689422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:39.698918 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:39.700345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624f959-828e-4e8d-a93f-df6287b31112 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:39.711756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1262/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:40.004898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.006408 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:40.021109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d18331-268c-4f3b-b9ef-8ac394ac05cc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.028379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.029032 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.029306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.029572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] PATH_INFO: `/v3/projects/525c72f32bff44ed874fed54e85105e7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.030713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] RBAC: Authorizing `identity:delete_project(project_id=525c72f32bff44ed874fed54e85105e7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.032731 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.085495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525c72f32bff44ed874fed54e85105e7', 'request_id': 'req-9b79d23a-48a8-42f1-a08f-180ca0ea894a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:40.092097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525c72f32bff44ed874fed54e85105e7', 'request_id': 'req-9b79d23a-48a8-42f1-a08f-180ca0ea894a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:40.101018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525c72f32bff44ed874fed54e85105e7', 'request_id': 'req-9b79d23a-48a8-42f1-a08f-180ca0ea894a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:40.112959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] The token cache is being invalidate because project 525c72f32bff44ed874fed54e85105e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:40.113243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:40.113881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b79d23a-48a8-42f1-a08f-180ca0ea894a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:40.115725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1251/2513] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:40 2022] DELETE /identity/v3/projects/525c72f32bff44ed874fed54e85105e7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:40.120616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.120911 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.121175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.141846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:40.143064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:40.206414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1263/2514] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:06:40.214152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.214437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.214712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.234727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:40.236551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:40.245173 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1252/2515] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:40.249485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.263211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a3bea-3899-48fe-a977-ab9dbfdee55d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.268189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.268825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.269131 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.269397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.270036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:06:40.270335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.271917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.284433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1264/2516] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:06:40.288942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.298548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3e0cf-c717-45c9-aa7e-99b356498fe6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.303371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.304229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.304503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.304802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.305550 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.307441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.340792 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1253/2517] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:40.342087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.352107 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7798350-1ce9-44e4-907a-3111d23fccf7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.355683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:40.409669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.410344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.410660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.410935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.411572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.413525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.439152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1265/2518] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:40.439971 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.450167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f618-8298-43d4-92c6-2c674f80962b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.455070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.455670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.455946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.456213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.456966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.458492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.471176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1254/2519] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:40.474373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.484479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8d7e4-1f45-4e28-ac25-14f78c0f45af admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.489956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.490553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.490852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.491118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.491780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.493487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe9fa2-2386-49c2-9b30-37dadc5e8e90 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.505224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1266/2520] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:40.509321 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.519638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6037eba-896f-4716-9c99-0248e6fdd4bb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.524397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.525129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.525393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.525612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] PATH_INFO: `/v3/projects/710406c0ee21437293e85b29ec24d5cf/users/b78825cc7ebe494e9dc653757bce3fef/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.541597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710406c0ee21437293e85b29ec24d5cf, user_id=b78825cc7ebe494e9dc653757bce3fef, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.544255 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.559972 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1255/2521] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:40 2022] PUT /identity/v3/projects/710406c0ee21437293e85b29ec24d5cf/users/b78825cc7ebe494e9dc653757bce3fef/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:40.570887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.571173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.571626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.601075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] MFA Rules not processed for user `b78825cc7ebe494e9dc653757bce3fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:40.602291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:40.670128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1267/2522] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:40.674912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.709342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:40.746027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfdde-6ab2-4e2b-bb25-32aa9b6777d4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.751578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.752194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.752477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.752790 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.753436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.755367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.786813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1256/2523] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:40.787940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.800248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44328-0b1f-404a-bb79-d6705deb433c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.859424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.860776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.861061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.861331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.861959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.863865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.886933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1268/2524] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:40 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:40.891050 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.901943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca842a72-0b08-452f-a65b-4949e7f5c895 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.906674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.907367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.907640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.907907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.908552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.910266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.920976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1257/2525] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:40.925761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.932280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:40.936308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35435cf-0661-484d-a17b-fc4f985120b4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:40.942437 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:40.943233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:40.943507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:40.944402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] PATH_INFO: `/v3/projects/10bf345a1dd14bfeb185ad9e42474995/users/f7bbe3d497c1414daba9b63a695fd6e1/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:40.961810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bf345a1dd14bfeb185ad9e42474995, user_id=f7bbe3d497c1414daba9b63a695fd6e1, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:40.964567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ebf95-9526-42ff-8a87-359d9b08635b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:40.979229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1269/2526] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:40 2022] PUT /identity/v3/projects/10bf345a1dd14bfeb185ad9e42474995/users/f7bbe3d497c1414daba9b63a695fd6e1/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:40.983740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:40.994689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bc39-1709-4cc3-8ee2-7a3deaaf2fbd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:41.059608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:41.060347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.061287 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.061430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.062144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:41.064508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:41.076221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1258/2527] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:41.087606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.087892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.088166 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.090224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:41.100951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc174-d14f-4168-8696-3cb99b3e453a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:41.106787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:41.107815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.108170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.108448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] PATH_INFO: `/v3/projects/10bf345a1dd14bfeb185ad9e42474995/users/f7bbe3d497c1414daba9b63a695fd6e1/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.109165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] MFA Rules not processed for user `7ddba1ca7ae845ecb82b92e8035b9178`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:41.111044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bf345a1dd14bfeb185ad9e42474995, user_id=f7bbe3d497c1414daba9b63a695fd6e1, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:41.111171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:41.113717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409362e-7c9d-4aa2-aa66-801cb1d9322a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:41.124633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1259/2528] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:41 2022] PUT /identity/v3/projects/10bf345a1dd14bfeb185ad9e42474995/users/f7bbe3d497c1414daba9b63a695fd6e1/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:06:41.136435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.136771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.137042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.166327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1270/2529] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 07:06:41.166716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] MFA Rules not processed for user `f7bbe3d497c1414daba9b63a695fd6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:41.168095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:41.241005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1260/2530] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:06:41.252643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:41.254036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:41.315106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf5606-92d4-4d1a-8ef6-c471f3c49351 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:41.368475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:41.369133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.369411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.369683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.380943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:41.382401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a455d8-8282-49ed-91f6-5d6d7ce38467 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:41.392905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1271/2531] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:41 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:41.560607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:41.571101 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:41.626826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600211b8-b3b2-4cfa-93b3-307857312fa9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:41.631220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:41.631854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.632130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.632398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] PATH_INFO: `/v3/users/b78825cc7ebe494e9dc653757bce3fef` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.633663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78825cc7ebe494e9dc653757bce3fef)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:41.635597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:41.685330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78825cc7ebe494e9dc653757bce3fef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:41.694657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78825cc7ebe494e9dc653757bce3fef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:41.695803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78825cc7ebe494e9dc653757bce3fef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:41.696914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78825cc7ebe494e9dc653757bce3fef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:41.714324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78825cc7ebe494e9dc653757bce3fef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:41.728249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1261/2532] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:41 2022] DELETE /identity/v3/users/b78825cc7ebe494e9dc653757bce3fef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:41.733045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.733538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.733765 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.753402 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:41.754723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:41.807129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:41.826904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1272/2533] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:41.839584 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:41.842941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:41.904993 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1af7c7-d8f4-47a0-b371-bdeeb511946d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:41.908891 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:41.909566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:41.909846 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:41.910113 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:41.919498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:41.921058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:41.931105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1262/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:42.227876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:42.229386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:42.242363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41867b22-3a2b-42b0-ac8c-9c538179dc5a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:42.247201 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:42.247922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:42.248198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:42.248467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] PATH_INFO: `/v3/projects/710406c0ee21437293e85b29ec24d5cf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:42.249767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710406c0ee21437293e85b29ec24d5cf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:42.252446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:42.306688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710406c0ee21437293e85b29ec24d5cf', 'request_id': 'req-c6dab491-678a-4b02-b14a-a484d58eae78'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.314687 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710406c0ee21437293e85b29ec24d5cf', 'request_id': 'req-c6dab491-678a-4b02-b14a-a484d58eae78'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.319965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710406c0ee21437293e85b29ec24d5cf', 'request_id': 'req-c6dab491-678a-4b02-b14a-a484d58eae78'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.331731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] The token cache is being invalidate because project 710406c0ee21437293e85b29ec24d5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:42.332034 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.332699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.334161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1273/2535] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:42 2022] DELETE /identity/v3/projects/710406c0ee21437293e85b29ec24d5cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:42.338133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:42.348974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d774e7-c95e-471a-9818-b7b3490da604 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:42.378996 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:42.413681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:42.414751 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:42.415244 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:42.415732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] PATH_INFO: `/v3/users/f7bbe3d497c1414daba9b63a695fd6e1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:42.417633 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bbe3d497c1414daba9b63a695fd6e1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:42.421624 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:42.491999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bbe3d497c1414daba9b63a695fd6e1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.503270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bbe3d497c1414daba9b63a695fd6e1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.503896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bbe3d497c1414daba9b63a695fd6e1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.504500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bbe3d497c1414daba9b63a695fd6e1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.518434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-10fad911-d179-4ea6-aa9a-3249997a7dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bbe3d497c1414daba9b63a695fd6e1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.531018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1263/2536] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:42 2022] DELETE /identity/v3/users/f7bbe3d497c1414daba9b63a695fd6e1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:42.815526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:42.817030 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:42.830976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab491-678a-4b02-b14a-a484d58eae78 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:42.888158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:42.888851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:42.889134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:42.889408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] PATH_INFO: `/v3/projects/10bf345a1dd14bfeb185ad9e42474995` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:42.890519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bf345a1dd14bfeb185ad9e42474995)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:42.893113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:42.943230 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bf345a1dd14bfeb185ad9e42474995', 'request_id': 'req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.951635 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bf345a1dd14bfeb185ad9e42474995', 'request_id': 'req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.960163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bf345a1dd14bfeb185ad9e42474995', 'request_id': 'req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.967675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:42.973295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] The token cache is being invalidate because project 10bf345a1dd14bfeb185ad9e42474995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:42.973763 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.975874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8078e39b-a7c1-41d3-b7c7-cec7355c8fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:42.977559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1274/2537] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:42 2022] DELETE /identity/v3/projects/10bf345a1dd14bfeb185ad9e42474995 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:42.982452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:42.983052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:42.983052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.008201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:43.009495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:43.089786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1264/2538] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:43.095954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.096249 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.096515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.117628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:43.118839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:43.132009 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1275/2539] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:43.136007 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.154336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678bb9f-f5f5-4640-b9a4-6e90ee78c336 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.161553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.162174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.162454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.162740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.163373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:06:43.163676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.166544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.185750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1265/2540] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:06:43.187170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.197447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1324be-ebc4-44fb-9a2d-3cbb0a924857 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.202365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.202975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.203253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.203552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.204821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.206735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.237170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1276/2541] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:43.241534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.252727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e57ea-eb09-499e-b049-b9e40e417476 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.294594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:43.319828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.320439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.320746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.321022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.321662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.323598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.350583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1266/2542] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:43.354905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.370103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ea501-1c0e-42a7-aeb5-0810a4b7b185 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.375432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.376176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.376435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.376749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.377404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.379007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.389778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1277/2543] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:43.393757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.403878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ddc40-ea82-4d0f-aa49-0fcd3bd97e7e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.409719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.410353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.410631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.410902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.411543 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.413178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1756b5-a62f-43cb-81c8-fa920bd7bc4c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.424346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1267/2544] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:43.428626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.440048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11173c-bce4-4476-b1ad-2da50223229e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.444768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.445427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.445708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.445980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] PATH_INFO: `/v3/projects/6ac537f2fef44618b407b9899ee4f80e/users/fdd0da2fa5fd40738a34a33842946f7c/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.460692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac537f2fef44618b407b9899ee4f80e, user_id=fdd0da2fa5fd40738a34a33842946f7c, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.463352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.478053 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1278/2545] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:43 2022] PUT /identity/v3/projects/6ac537f2fef44618b407b9899ee4f80e/users/fdd0da2fa5fd40738a34a33842946f7c/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:06:43.489034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.489328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.489602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.518631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] MFA Rules not processed for user `fdd0da2fa5fd40738a34a33842946f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:43.519897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:43.595853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1268/2546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:43.600443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.665350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0635-a8d0-4553-9df3-61626b4e473a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.670265 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.670869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.671148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.671416 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.672069 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.674723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.702060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1279/2547] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:06:43.706233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.717454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6ed3-e499-48ff-a08f-2aa8f1cd5569 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.775215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.775951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.776253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.776503 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.777144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.779062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.804402 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1269/2548] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:06:43.805668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.817027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa17d0f-ae4b-4bc2-b52f-981bb0076c29 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.822378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.822975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.823258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.823528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.824269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.826834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.840293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1280/2549] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:43.844445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.854421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a478-f33a-4e56-bad5-9b11822143a3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.859599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.861010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.861342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.861620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] PATH_INFO: `/v3/projects/18bd7c53c057488d9d97eabb7a5bee99/users/9ac6fdd2450540e39405226cb534acb3/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.878611 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bd7c53c057488d9d97eabb7a5bee99, user_id=9ac6fdd2450540e39405226cb534acb3, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.881884 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:43.898415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1270/2550] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:43 2022] PUT /identity/v3/projects/18bd7c53c057488d9d97eabb7a5bee99/users/9ac6fdd2450540e39405226cb534acb3/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:43.902336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:43.914454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422369-55d4-4147-9cda-0fd5c477341b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:43.994059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:43.994788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:43.995133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:43.995475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:43.996228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:43.998036 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f732b0-dc44-4c05-aff4-402c9f7965c2 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:44.011232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1281/2551] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:44.015210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:44.029060 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05282648-76d3-4267-ab1d-cefc684a7820 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:44.036421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:44.037612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:44.038266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:44.038901 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] PATH_INFO: `/v3/projects/18bd7c53c057488d9d97eabb7a5bee99/users/9ac6fdd2450540e39405226cb534acb3/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:44.041778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bd7c53c057488d9d97eabb7a5bee99, user_id=9ac6fdd2450540e39405226cb534acb3, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:44.044448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:44.051354 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:44.060636 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1271/2552] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:44 2022] PUT /identity/v3/projects/18bd7c53c057488d9d97eabb7a5bee99/users/9ac6fdd2450540e39405226cb534acb3/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:44.071031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:44.071408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:44.072165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:44.081977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:44.108332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] MFA Rules not processed for user `9ac6fdd2450540e39405226cb534acb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:44.109762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:44.183427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1282/2553] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:44.196212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:44.199021 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:44.265440 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f26b-a565-42c3-a7a9-d72abb62c843 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:44.269613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:44.270216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:44.270487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:44.270750 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:44.279859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:44.281317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778c01b-107e-42de-99d4-04c205fdc38e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:44.291961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1272/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:44.768704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:44.842664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52e13-1993-49fd-951b-2ad7bf7b5c10 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:44.847539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:44.848167 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:44.848439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:44.848736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] PATH_INFO: `/v3/users/fdd0da2fa5fd40738a34a33842946f7c` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:44.849851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd0da2fa5fd40738a34a33842946f7c)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:44.851804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:44.900196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd0da2fa5fd40738a34a33842946f7c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:44.908288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd0da2fa5fd40738a34a33842946f7c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:44.908984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd0da2fa5fd40738a34a33842946f7c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:44.909599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd0da2fa5fd40738a34a33842946f7c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:44.916764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd0da2fa5fd40738a34a33842946f7c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:44.935250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1283/2555] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:44 2022] DELETE /identity/v3/users/fdd0da2fa5fd40738a34a33842946f7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:44.940341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:44.940644 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:44.940913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:44.963523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:44.964852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:45.033396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1273/2556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:45.043123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:45.044533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:45.055844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:45.106854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5728e-6296-4ad3-ae38-8673e197aca7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:45.111245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:45.111876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:45.112135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:45.112413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:45.122105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:45.123543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:45.133667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1284/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:45.400789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:45.402685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:45.420378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07589fe2-8029-4674-8efd-6d754d67272b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:45.426404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:45.427130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:45.427330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:45.427597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] PATH_INFO: `/v3/projects/6ac537f2fef44618b407b9899ee4f80e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:45.429008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac537f2fef44618b407b9899ee4f80e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:45.430929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:45.481039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac537f2fef44618b407b9899ee4f80e', 'request_id': 'req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.487622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac537f2fef44618b407b9899ee4f80e', 'request_id': 'req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.495176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac537f2fef44618b407b9899ee4f80e', 'request_id': 'req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.506079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] The token cache is being invalidate because project 6ac537f2fef44618b407b9899ee4f80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:45.506363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.506974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.508427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1274/2558] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:45 2022] DELETE /identity/v3/projects/6ac537f2fef44618b407b9899ee4f80e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:45.512572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:45.522681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047fa21-9b3c-4967-8678-34324b46950e service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:45.579165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:45.579934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:45.580216 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:45.580492 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] PATH_INFO: `/v3/users/9ac6fdd2450540e39405226cb534acb3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:45.581638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac6fdd2450540e39405226cb534acb3)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:45.583546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:45.627878 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac6fdd2450540e39405226cb534acb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.636079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac6fdd2450540e39405226cb534acb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.636803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac6fdd2450540e39405226cb534acb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.637440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac6fdd2450540e39405226cb534acb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.644845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-57b19dca-cc9f-4bc9-830b-9bca3d6f7eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac6fdd2450540e39405226cb534acb3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:45.662826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1285/2559] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:45 2022] DELETE /identity/v3/users/9ac6fdd2450540e39405226cb534acb3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:45.948443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:45.950080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:45.965549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a359eb-e9e7-40a6-beb7-5cb87298adcf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:45.987090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:46.025735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.025873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.026109 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.026385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] PATH_INFO: `/v3/projects/18bd7c53c057488d9d97eabb7a5bee99` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.027539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bd7c53c057488d9d97eabb7a5bee99)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.029599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.075989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bd7c53c057488d9d97eabb7a5bee99', 'request_id': 'req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:46.083011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bd7c53c057488d9d97eabb7a5bee99', 'request_id': 'req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:46.089616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bd7c53c057488d9d97eabb7a5bee99', 'request_id': 'req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:46.100754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] The token cache is being invalidate because project 18bd7c53c057488d9d97eabb7a5bee99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:46.101098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:46.101721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-bb0a88da-1c63-482a-8fa3-e2cbd7e03f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:46.103222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1275/2560] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:45 2022] DELETE /identity/v3/projects/18bd7c53c057488d9d97eabb7a5bee99 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:46.108165 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.108657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.108771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.130531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:46.131743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:46.158106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:46.195040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1286/2561] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:46.202779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.203062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.203399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.223555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:46.224777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:46.232744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1276/2562] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:06:46.238087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.248389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa0321-182e-44fc-8a14-5882a67ecb9d None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.253680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.254280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.254560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.254831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.255479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:06:46.255787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.257471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.273205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1287/2563] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:06:46.274545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.285070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2436-3897-4574-886f-b0834edf27fb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.290005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.290693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.290969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.291238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.291933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.293893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.325761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1277/2564] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:06:46.327157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.337774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b140644-3e1a-4233-9f39-d6f5625773de admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.396497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.397120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.397397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.397665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.398307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.400565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.425959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1288/2565] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:46.427424 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.439821 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491954de-8acd-4563-bc1c-26b02a98cdb9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.445266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.445928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.446216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.446496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.447138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.448786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.462710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1278/2566] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:46.464389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.476148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e83a9-b683-4f80-9e17-661b477396a4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.481239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.481892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.482645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.483015 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.484005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.486397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13f897-3f8e-4f0b-9b02-61fc88f3b510 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.497445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1289/2567] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:46.501690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.511918 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edd92-804e-4816-a2db-ae1a95a84fef admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.517514 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.518813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.518813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.518813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] PATH_INFO: `/v3/projects/f4762c5a64a44fa8a46a94ceb4356c73/users/3e6005b63e054b07a98804e34d93accc/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.534323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4762c5a64a44fa8a46a94ceb4356c73, user_id=3e6005b63e054b07a98804e34d93accc, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.537011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.551065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1279/2568] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:46 2022] PUT /identity/v3/projects/f4762c5a64a44fa8a46a94ceb4356c73/users/3e6005b63e054b07a98804e34d93accc/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:46.562550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.563810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.564097 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.594066 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] MFA Rules not processed for user `3e6005b63e054b07a98804e34d93accc`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:46.595499 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:46.670050 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1290/2569] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:46.675470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.727650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:46.742030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773cfc-8c89-482b-b597-3c54b4be63a0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.746758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.747361 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.747637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.747907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.748542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.751318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.777691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1280/2570] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:46.781759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.792210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f85a6-bc97-451e-b351-94f46eada22c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.817445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:46.850965 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.851573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.851861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.852135 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.852805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.854714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.877021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1291/2571] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:46 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:46.880954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.891419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc8f1-6bc1-4d08-bb04-dcc253ffadf0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.896450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.897186 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.897558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.897945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.898673 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.900443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.912189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1281/2572] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:46.916065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.926322 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e2eb5-2dbb-43a1-be02-73f39e18525d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:46.931123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:46.931758 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:46.932032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:46.932301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] PATH_INFO: `/v3/projects/f298c6a243044d0f9fd858f45d2e6e37/users/54a3ca1264e84b5d87c30332652d57f7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:46.947087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f298c6a243044d0f9fd858f45d2e6e37, user_id=54a3ca1264e84b5d87c30332652d57f7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:46.949750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:46.962431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1292/2573] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:46 2022] PUT /identity/v3/projects/f298c6a243044d0f9fd858f45d2e6e37/users/54a3ca1264e84b5d87c30332652d57f7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:46.966353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:46.977240 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f488f3-f839-4dca-8476-3e89301c9c88 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:47.036416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:47.036992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:47.037275 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:47.037544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:47.038178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:47.039759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57495a77-961d-4653-b5de-e3e9eab3810f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:47.051015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1282/2574] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:47.055375 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:47.065368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33547bd9-cbb0-45ee-a579-d244ebf02213 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:47.069872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:47.070507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:47.070781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:47.071051 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] PATH_INFO: `/v3/projects/f298c6a243044d0f9fd858f45d2e6e37/users/54a3ca1264e84b5d87c30332652d57f7/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:47.072960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f298c6a243044d0f9fd858f45d2e6e37, user_id=54a3ca1264e84b5d87c30332652d57f7, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:47.075577 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:47.086594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1293/2575] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:47 2022] PUT /identity/v3/projects/f298c6a243044d0f9fd858f45d2e6e37/users/54a3ca1264e84b5d87c30332652d57f7/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:47.097845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:47.098323 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:47.098491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:47.126430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] MFA Rules not processed for user `54a3ca1264e84b5d87c30332652d57f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:47.127615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:47.195716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1283/2576] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:47.207524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:47.209307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:47.265457 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e1a1-1582-4225-90cc-56b0c8d594eb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:47.269215 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:47.269809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:47.270083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:47.270350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:47.279046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:47.280455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:47.290650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1294/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:47.365056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:47.374544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e3cd4-2690-4f67-941a-33da19a54436 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:47.378521 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:47.379107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:47.379379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:47.379652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:47.423269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:47.436512 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:47.438118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:47.447043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1284/2578] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:53.614837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:53.616351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:53.694575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d30f4b-ac53-4507-b000-ae37060dc218 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:53.700137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:53.700774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:53.701055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:53.701325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:53.703059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:53.715404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:53.717012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306dc4-11e8-4ecf-b6ac-a424cf9986b9 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:53.728191 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1295/2579] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:54.569414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:54.648138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74e26-8286-4ef1-a9a6-157cef0dc2d3 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:54.653079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:54.653745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:54.654071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:54.654301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] PATH_INFO: `/v3/users/3e6005b63e054b07a98804e34d93accc` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:54.655456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6005b63e054b07a98804e34d93accc)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:54.657941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:54.712120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6005b63e054b07a98804e34d93accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:54.720472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6005b63e054b07a98804e34d93accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:54.721183 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6005b63e054b07a98804e34d93accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:54.721798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6005b63e054b07a98804e34d93accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:54.735191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6005b63e054b07a98804e34d93accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:54.748209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1285/2580] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:54 2022] DELETE /identity/v3/users/3e6005b63e054b07a98804e34d93accc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:54.753137 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:54.753660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:54.753790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:54.767433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:54.774220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:54.775760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:54.836761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1296/2581] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:54.847273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:54.848782 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:54.905806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f056746-dc18-4387-b05b-f3bda31f051d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:54.909388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:54.909984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:54.910256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:54.910527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:54.919279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:54.920728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:54.930886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1286/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:55.204880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:55.206393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:55.220674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876c41-90ea-4cbc-9956-de7f65a9d4ef None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:55.225511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:55.226386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:55.226757 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:55.227126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] PATH_INFO: `/v3/projects/f4762c5a64a44fa8a46a94ceb4356c73` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:55.228339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4762c5a64a44fa8a46a94ceb4356c73)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:55.230627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:55.281316 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4762c5a64a44fa8a46a94ceb4356c73', 'request_id': 'req-017ce953-3f48-4fc6-9743-9de4d37d22d6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.289277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4762c5a64a44fa8a46a94ceb4356c73', 'request_id': 'req-017ce953-3f48-4fc6-9743-9de4d37d22d6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.294986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4762c5a64a44fa8a46a94ceb4356c73', 'request_id': 'req-017ce953-3f48-4fc6-9743-9de4d37d22d6'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.309670 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] The token cache is being invalidate because project f4762c5a64a44fa8a46a94ceb4356c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:55.310072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.310739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.312435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1297/2583] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:55 2022] DELETE /identity/v3/projects/f4762c5a64a44fa8a46a94ceb4356c73 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:55.316665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:55.326107 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe20ae-b598-41cf-8883-a3386b5f3c31 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:55.330356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:55.383883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:55.384507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:55.384811 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:55.385082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] PATH_INFO: `/v3/users/54a3ca1264e84b5d87c30332652d57f7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:55.386180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a3ca1264e84b5d87c30332652d57f7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:55.388077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:55.432681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a3ca1264e84b5d87c30332652d57f7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.440238 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a3ca1264e84b5d87c30332652d57f7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.440874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a3ca1264e84b5d87c30332652d57f7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.441487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a3ca1264e84b5d87c30332652d57f7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.453348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a26b4c04-e2a9-417d-89c6-8f7eaaac4936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a3ca1264e84b5d87c30332652d57f7'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.465551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1287/2584] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:06:55 2022] DELETE /identity/v3/users/54a3ca1264e84b5d87c30332652d57f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:55.735593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:55.737084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:55.753173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce953-3f48-4fc6-9743-9de4d37d22d6 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:55.812094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:55.812795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:55.813077 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:55.813370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] PATH_INFO: `/v3/projects/f298c6a243044d0f9fd858f45d2e6e37` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:55.814459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f298c6a243044d0f9fd858f45d2e6e37)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:55.816358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:55.853430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:55.866202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f298c6a243044d0f9fd858f45d2e6e37', 'request_id': 'req-04c6eb44-8bc8-4dce-b274-0bb85677fa29'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.872529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f298c6a243044d0f9fd858f45d2e6e37', 'request_id': 'req-04c6eb44-8bc8-4dce-b274-0bb85677fa29'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.878258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f298c6a243044d0f9fd858f45d2e6e37', 'request_id': 'req-04c6eb44-8bc8-4dce-b274-0bb85677fa29'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.889554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] The token cache is being invalidate because project f298c6a243044d0f9fd858f45d2e6e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:06:55.889847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.890482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-04c6eb44-8bc8-4dce-b274-0bb85677fa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:06:55.892750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1298/2585] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:06:55 2022] DELETE /identity/v3/projects/f298c6a243044d0f9fd858f45d2e6e37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:55.897692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:55.898172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:55.898284 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:55.917945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:55.919115 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:55.978610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1288/2586] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:55.986702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:55.986984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:55.987254 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.007012 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:56.008212 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:56.016747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1299/2587] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:56.023049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.033612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ac78-cb92-4932-815e-fa6ccddf2902 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.038248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.038848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.039125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.039394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.040039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:06:56.040337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.041989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.054044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1289/2588] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:06:56.058418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.067943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28e9d1-0e9b-4ec6-8787-1e6ef1ecb474 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.072560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.073182 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.073459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.073729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.074355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.076236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.104016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1300/2589] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:56.108066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.118537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cddb3-8cf6-4621-857f-5afad72c9eec admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.128168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:56.178143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.178979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.179259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.179522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.180140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.182070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.202786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1290/2590] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:56.207470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.217591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f5544-2c3c-4bde-b6a6-22bfc64d709a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.222386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.222975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.223255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.223524 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.224161 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.225811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.235626 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1301/2591] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:56.239501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.249213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedc8a0-825d-4902-9f90-c102d897d70b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.254355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.254940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.255217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.255487 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.256121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.257724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96bb2f-2b88-4e49-b3ef-aea9adebda07 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.268064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1291/2592] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:56.272018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.282380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682806-dc80-4f3b-b115-b633f0866117 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.286934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.287571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.287851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.288124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] PATH_INFO: `/v3/projects/44448bf0a4be4510a091acdad305469b/users/d8a5637e37134a1fb39dbd4f8268fdb1/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.304239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44448bf0a4be4510a091acdad305469b, user_id=d8a5637e37134a1fb39dbd4f8268fdb1, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.306892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.320571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1302/2593] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:56 2022] PUT /identity/v3/projects/44448bf0a4be4510a091acdad305469b/users/d8a5637e37134a1fb39dbd4f8268fdb1/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:56.332366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.332686 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.332958 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.360462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] MFA Rules not processed for user `d8a5637e37134a1fb39dbd4f8268fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:56.361684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:56.425011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1292/2594] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:56.429629 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.490662 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef3373-8534-4a85-a026-849baef0b96e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.495253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.495860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.496142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.496418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.497084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.498984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.525589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1303/2595] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:56.529651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.540675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a216c3-d465-4d64-9154-b98f2afc72a2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.598204 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.598812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.599111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.599362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.599998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.601939 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.622854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1293/2596] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:06:56.627308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.637694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393774a-b010-4481-b6b2-e6f3ac04d256 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.642936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.643531 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.643823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.644115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.644832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.646415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.657458 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1304/2597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:06:56.661607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.671432 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f872-dfa8-4356-8158-256c74ec4ab4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.676329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.676999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.677278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.677542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] PATH_INFO: `/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb/users/b445188dd6ec42f8bdbcbfb5bb921cf0/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.686161 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:56.694606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adfe0369c1a45c3b7ce6ac1bcdb99fb, user_id=b445188dd6ec42f8bdbcbfb5bb921cf0, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.697341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.710586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1294/2598] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:56 2022] PUT /identity/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb/users/b445188dd6ec42f8bdbcbfb5bb921cf0/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:56.714722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.725219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382fa34-70ab-433a-9d7d-53f1dd83c412 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.753275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:06:56.783616 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.784225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.784506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.784813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.785456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.787043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00eebf-1073-4c66-aba6-03ebcab3c0ff admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.796851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1305/2599] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:06:56.801216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.811791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ec16-60a1-48e5-8bf1-31772650d539 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:56.817300 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:56.817949 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.818228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.818501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] PATH_INFO: `/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb/users/b445188dd6ec42f8bdbcbfb5bb921cf0/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.820401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adfe0369c1a45c3b7ce6ac1bcdb99fb, user_id=b445188dd6ec42f8bdbcbfb5bb921cf0, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:56.823059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:56.834082 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1295/2600] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:06:56 2022] PUT /identity/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb/users/b445188dd6ec42f8bdbcbfb5bb921cf0/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:06:56.845454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:56.845742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:56.846013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:56.872865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] MFA Rules not processed for user `b445188dd6ec42f8bdbcbfb5bb921cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:06:56.874058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:56.941642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1306/2601] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:06:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:06:56.952969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:56.955421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:57.013199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554daf-3a88-459c-ba21-ffaab673d1ba admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:57.018037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:57.018652 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:57.018926 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:57.019194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:57.076469 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:57.077920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:57.086934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1296/2602] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:06:58.442497 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:06:58.443897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:06:58.456430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fc91d-aed1-4e6d-80b2-2ae9b7b418d9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:06:58.459956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:06:58.460551 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:06:58.460856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:06:58.461129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:06:58.469883 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:06:58.471296 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47985d54-8735-4b9e-a34c-d86b5db8014d service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:06:58.480682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1307/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:06:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:02.293671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:02.356236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9260-1b9d-4bbf-b5b8-f094ffc1666c service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:02.363262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:02.363262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:02.363262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:02.363262 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] PATH_INFO: `/v3/users/d8a5637e37134a1fb39dbd4f8268fdb1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:02.364305 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a5637e37134a1fb39dbd4f8268fdb1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:02.366246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:02.398494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:02.413303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a5637e37134a1fb39dbd4f8268fdb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:02.420516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a5637e37134a1fb39dbd4f8268fdb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:02.421165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a5637e37134a1fb39dbd4f8268fdb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:02.421775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a5637e37134a1fb39dbd4f8268fdb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:02.434071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a5637e37134a1fb39dbd4f8268fdb1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:02.446069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1297/2604] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:02 2022] DELETE /identity/v3/users/d8a5637e37134a1fb39dbd4f8268fdb1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:02.450456 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:02.450934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:02.451031 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:02.471792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:02.473033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:02.534189 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1308/2605] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:02.544010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:02.545570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:02.602077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31f9f0-bb38-4805-9b62-aac1066eed0a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:02.605936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:02.606544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:02.606816 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:02.607080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:02.616880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:02.618311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:02.630379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1298/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:03.192128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:03.193694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:03.213112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858c18b-9eda-4780-819e-cead5b415cbd None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:03.218248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:03.227720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:03.228026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:03.228308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] PATH_INFO: `/v3/projects/44448bf0a4be4510a091acdad305469b` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:03.229650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44448bf0a4be4510a091acdad305469b)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:03.231606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:03.280039 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:03.296981 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44448bf0a4be4510a091acdad305469b', 'request_id': 'req-ff8a759a-de02-434b-bfde-2f47eb4acae7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.306140 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44448bf0a4be4510a091acdad305469b', 'request_id': 'req-ff8a759a-de02-434b-bfde-2f47eb4acae7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.313268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44448bf0a4be4510a091acdad305469b', 'request_id': 'req-ff8a759a-de02-434b-bfde-2f47eb4acae7'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.328957 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] The token cache is being invalidate because project 44448bf0a4be4510a091acdad305469b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:03.329246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.329920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.331417 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1309/2607] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:03 2022] DELETE /identity/v3/projects/44448bf0a4be4510a091acdad305469b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:03.335650 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:03.351956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f0d-cbdd-4ec4-ac2d-a66054e40a21 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:03.433799 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:03.434525 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:03.434878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:03.435304 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] PATH_INFO: `/v3/users/b445188dd6ec42f8bdbcbfb5bb921cf0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:03.436632 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b445188dd6ec42f8bdbcbfb5bb921cf0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:03.438654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:03.491249 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b445188dd6ec42f8bdbcbfb5bb921cf0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.495364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:03.502320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b445188dd6ec42f8bdbcbfb5bb921cf0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.503292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b445188dd6ec42f8bdbcbfb5bb921cf0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.504199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b445188dd6ec42f8bdbcbfb5bb921cf0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.517794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7ba9e0dc-684d-4d2c-ac6e-f74af527dc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b445188dd6ec42f8bdbcbfb5bb921cf0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:03.530754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1299/2608] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:03 2022] DELETE /identity/v3/users/b445188dd6ec42f8bdbcbfb5bb921cf0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:03.912146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:03.913767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:03.927508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a759a-de02-434b-bfde-2f47eb4acae7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:03.988274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:03.988944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:03.989227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:03.989503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] PATH_INFO: `/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:03.990621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adfe0369c1a45c3b7ce6ac1bcdb99fb)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:03.992718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.042168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adfe0369c1a45c3b7ce6ac1bcdb99fb', 'request_id': 'req-27772383-5c23-414b-b78c-6f384e51e22b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:04.050504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adfe0369c1a45c3b7ce6ac1bcdb99fb', 'request_id': 'req-27772383-5c23-414b-b78c-6f384e51e22b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:04.056744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adfe0369c1a45c3b7ce6ac1bcdb99fb', 'request_id': 'req-27772383-5c23-414b-b78c-6f384e51e22b'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:04.068599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] The token cache is being invalidate because project 7adfe0369c1a45c3b7ce6ac1bcdb99fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:04.068887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:04.069518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-27772383-5c23-414b-b78c-6f384e51e22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:04.070986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1310/2609] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:03 2022] DELETE /identity/v3/projects/7adfe0369c1a45c3b7ce6ac1bcdb99fb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:04.075851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df7467-a457-4034-beda-cb309276877f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.076139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df7467-a457-4034-beda-cb309276877f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.076430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df7467-a457-4034-beda-cb309276877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.096780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-59df7467-a457-4034-beda-cb309276877f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:04.097969 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-59df7467-a457-4034-beda-cb309276877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:04.157683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1300/2610] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:04.165364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.165648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.165940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.186881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:04.188778 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:04.196439 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1311/2611] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:04.200546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df7467-a457-4034-beda-cb309276877f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.210232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df7467-a457-4034-beda-cb309276877f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.214793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.215388 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.215666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.215936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.216609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:04.216910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.218549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.230084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1301/2612] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:07:04.234835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.244353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fabdf-ae70-4998-9050-0c8751acc3af None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.248967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.249555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.249836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.251207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.251867 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.253795 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.279961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1312/2613] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:04.284954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.294849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757e0f3-c4f7-4d87-b613-2a248b8d077a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.351489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.352169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.352443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.352749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.353420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.355468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.377826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1302/2614] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:04.381942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.392617 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dcbcd-8dce-4385-ad84-f95d41b255f3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.397308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.397899 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.398175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.398445 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.399093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.400826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.412342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1313/2615] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:04.418247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.429117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acc90f-df46-433a-b3ee-8104a2446091 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.433736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.434330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.434607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.434877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.435515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.437136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d5858-b53b-4469-8403-e49710cecfb0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.447742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1303/2616] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:04.451799 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.461766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68bc26-c1dd-4b2f-a962-e5f0d6d75ac7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.466355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.466986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.467261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.467528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] PATH_INFO: `/v3/projects/98632c0ae6a7480b944191d0276fbc45/users/7636bf68c76646f78552c7775c7694f0/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.478860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:04.483199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=98632c0ae6a7480b944191d0276fbc45, user_id=7636bf68c76646f78552c7775c7694f0, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.486600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.500228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1314/2617] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:04 2022] PUT /identity/v3/projects/98632c0ae6a7480b944191d0276fbc45/users/7636bf68c76646f78552c7775c7694f0/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:04.510515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.510801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.511076 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.538815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] MFA Rules not processed for user `7636bf68c76646f78552c7775c7694f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:04.540011 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:04.565126 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:04.608860 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1304/2618] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:04.614601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.676163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca228-6401-48d2-838b-e8c3ca9ad6cb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.681007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.681628 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.681902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.682176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.682865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.684820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.712808 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1315/2619] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:04.716893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.728052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f3be7-a92a-484e-87d9-44dc8d921d7b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.784515 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.785156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.785430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.785697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.786317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.788207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.809871 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1305/2620] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:04 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:04.813739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.823923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bf196-ba49-45c7-85d9-2f967c77de99 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.829091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.829691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.829966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.830236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.830873 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.832527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.843606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1316/2621] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:04.848117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.858270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c5979-253e-4f29-8b67-a38c9fb73988 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.862869 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.863549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.863823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.864108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] PATH_INFO: `/v3/projects/20254ab190f44c21a6afdb4973b58219/users/f8ed6ccbcfb2473096c2330439fc663c/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.879390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=20254ab190f44c21a6afdb4973b58219, user_id=f8ed6ccbcfb2473096c2330439fc663c, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.882098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.896470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1306/2622] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:04 2022] PUT /identity/v3/projects/20254ab190f44c21a6afdb4973b58219/users/f8ed6ccbcfb2473096c2330439fc663c/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:04.901281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:04.916089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e38b7-8d44-4600-ac97-493974e21a29 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:04.972797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:04.973321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:04.973601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:04.973872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:04.974525 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:04.976110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55e82-4fbb-4bdb-812b-ac3ed57d7ed4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:04.989337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1317/2623] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:04.990519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:05.001575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068867d-a3a5-4f49-ac85-f69718e35dba admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:05.006528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:05.007174 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:05.007451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:05.007719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] PATH_INFO: `/v3/projects/20254ab190f44c21a6afdb4973b58219/users/f8ed6ccbcfb2473096c2330439fc663c/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:05.009677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20254ab190f44c21a6afdb4973b58219, user_id=f8ed6ccbcfb2473096c2330439fc663c, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:05.012312 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:05.023936 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1307/2624] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:04 2022] PUT /identity/v3/projects/20254ab190f44c21a6afdb4973b58219/users/f8ed6ccbcfb2473096c2330439fc663c/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:05.034184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:05.034475 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:05.034751 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:05.064001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] MFA Rules not processed for user `f8ed6ccbcfb2473096c2330439fc663c`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:05.065318 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:05.110700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:05.133104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1318/2625] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:05.143899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:05.145670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:05.205143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc30760-b97e-4ee2-81c5-42c29e2ce8f6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:05.208954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:05.209497 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:05.209778 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:05.210077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:05.219484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:05.220954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:05.230378 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1308/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:05.276715 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:05.279660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:05.292747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a5f82-0395-467e-806d-08299269ea36 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:05.296330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:05.297618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:05.297896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:05.298163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:05.353376 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:05.354939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046615-18a6-4ba8-8067-81632bbab040 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:05.364423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1319/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:08.752562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:08.773683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:08.815781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d53af8-1eec-42ca-b9b9-8d3201c57e00 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:08.820263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:08.820911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:08.821187 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:08.821452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] PATH_INFO: `/v3/users/7636bf68c76646f78552c7775c7694f0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:08.822542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7636bf68c76646f78552c7775c7694f0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:08.824473 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:08.871691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7636bf68c76646f78552c7775c7694f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:08.879045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7636bf68c76646f78552c7775c7694f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:08.879665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7636bf68c76646f78552c7775c7694f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:08.880274 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7636bf68c76646f78552c7775c7694f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:08.892664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7636bf68c76646f78552c7775c7694f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:08.904720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1309/2628] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:08 2022] DELETE /identity/v3/users/7636bf68c76646f78552c7775c7694f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:08.909889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:08.910378 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:08.910503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:08.929933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:08.931145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:08.994111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1320/2629] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:09.002379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:09.003868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:09.072666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a532-b02b-4ae9-a832-25002df17727 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:09.077219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:09.077838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:09.078235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:09.078530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:09.088474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:09.090110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:09.101000 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1310/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:09.381567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:09.382937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:09.395388 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a309-f574-418e-beac-2c2c4b1633da None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:09.400000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:09.400674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:09.400960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:09.401235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] PATH_INFO: `/v3/projects/98632c0ae6a7480b944191d0276fbc45` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:09.402355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98632c0ae6a7480b944191d0276fbc45)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:09.404274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:09.452251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98632c0ae6a7480b944191d0276fbc45', 'request_id': 'req-6cdbdf30-74d4-4611-a1e1-858321049100'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.459356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98632c0ae6a7480b944191d0276fbc45', 'request_id': 'req-6cdbdf30-74d4-4611-a1e1-858321049100'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.465124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98632c0ae6a7480b944191d0276fbc45', 'request_id': 'req-6cdbdf30-74d4-4611-a1e1-858321049100'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.476200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] The token cache is being invalidate because project 98632c0ae6a7480b944191d0276fbc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:09.476494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.477174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.478649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1321/2631] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:09 2022] DELETE /identity/v3/projects/98632c0ae6a7480b944191d0276fbc45 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:09.482563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:09.496480 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b19cc-b3b7-4fc5-bbce-df5ddcb0e1d8 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:09.538530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:09.556297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:09.556956 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:09.557235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:09.557504 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] PATH_INFO: `/v3/users/f8ed6ccbcfb2473096c2330439fc663c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:09.558631 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ed6ccbcfb2473096c2330439fc663c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:09.560539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:09.604056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ed6ccbcfb2473096c2330439fc663c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.611363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ed6ccbcfb2473096c2330439fc663c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.612043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ed6ccbcfb2473096c2330439fc663c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.612661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ed6ccbcfb2473096c2330439fc663c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.624683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c8939fa2-65e7-4dc1-b932-5cbbe57145f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ed6ccbcfb2473096c2330439fc663c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:09.636687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1311/2632] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:09 2022] DELETE /identity/v3/users/f8ed6ccbcfb2473096c2330439fc663c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:09.914016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:09.915668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:09.929718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbdf30-74d4-4611-a1e1-858321049100 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:09.933498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:09.991632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:09.992261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:09.992545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:09.992846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] PATH_INFO: `/v3/projects/20254ab190f44c21a6afdb4973b58219` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:09.993962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20254ab190f44c21a6afdb4973b58219)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:09.995872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.045825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20254ab190f44c21a6afdb4973b58219', 'request_id': 'req-f9efe018-f481-4d21-9c50-adb7d73867a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:10.053380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20254ab190f44c21a6afdb4973b58219', 'request_id': 'req-f9efe018-f481-4d21-9c50-adb7d73867a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:10.059373 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20254ab190f44c21a6afdb4973b58219', 'request_id': 'req-f9efe018-f481-4d21-9c50-adb7d73867a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:10.070667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] The token cache is being invalidate because project 20254ab190f44c21a6afdb4973b58219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:10.070945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:10.071576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-f9efe018-f481-4d21-9c50-adb7d73867a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:10.073090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1322/2633] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:09 2022] DELETE /identity/v3/projects/20254ab190f44c21a6afdb4973b58219 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:10.078921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.078921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.079500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.099753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:10.101037 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.162039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1312/2634] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:10.229349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.229789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.230033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.254155 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:10.255358 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.255523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.256812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.263595 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1323/2635] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:10.268079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.276916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96af632-fd2d-4e09-90c1-cb551fae0321 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.282281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.282868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.283171 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.283870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.284511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:10.284855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.286847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.299019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1324/2636] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 07:07:10.303463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.314421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df552f-9721-4967-a649-ea9a36d358ad admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.315919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c966-65a2-424a-9dd1-1106fce23614 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.319429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.319776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.320030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.320303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.320403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.320567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.320689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.320925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.321553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.322411 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.323452 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.335946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.337485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.348842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1313/2637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:07:10.355714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1325/2638] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:10 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:10.359994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.366399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:10.370127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec388d2-7e82-4212-9264-f20749f37f74 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.429209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.429727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.430006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.430272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.430898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.432818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.456612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1314/2639] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:10 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:10.460339 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.471280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fce7d-8976-4d2c-b6c2-0c82b07a6b01 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.476021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.476642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.476925 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.477198 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.477986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.479586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.489991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1326/2640] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:10.493906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.505857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52bef6-686f-4043-84c3-765b30292013 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.511459 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.512343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.512639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.512917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.514243 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.516700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e374-e677-4618-b2a7-e32ac92a63d4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.527147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1315/2641] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:07:10.531455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.541300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52703-4ab1-4638-8342-45e8c5703b94 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.546105 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.546971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.547543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.547543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] PATH_INFO: `/v3/projects/2a0b76996f3a425fa3486174c155bf14/users/3507362652294e6bb4962902133ad8ce/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.564238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0b76996f3a425fa3486174c155bf14, user_id=3507362652294e6bb4962902133ad8ce, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.567084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.581002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1327/2642] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:10 2022] PUT /identity/v3/projects/2a0b76996f3a425fa3486174c155bf14/users/3507362652294e6bb4962902133ad8ce/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:10.586077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609c52-9b6c-4ce8-a1c6-6d837157748f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.586397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609c52-9b6c-4ce8-a1c6-6d837157748f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.586678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4609c52-9b6c-4ce8-a1c6-6d837157748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.607282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f4609c52-9b6c-4ce8-a1c6-6d837157748f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:10.608501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f4609c52-9b6c-4ce8-a1c6-6d837157748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.672651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1316/2643] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:10.682937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:10.684665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:10.707756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:10.746177 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c94e30-6d78-45ce-afd2-9137bdda4c04 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:10.750523 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:10.751139 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:10.751438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:10.751706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:10.760605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:10.762027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:10.772211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1328/2644] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:11.452929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9b41-125a-49b2-b119-674b65d81253 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:11.453517 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9b41-125a-49b2-b119-674b65d81253 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:11.453870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9b41-125a-49b2-b119-674b65d81253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:11.484850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b86d9b41-125a-49b2-b119-674b65d81253 None None] MFA Rules not processed for user `3507362652294e6bb4962902133ad8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:11.486237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b86d9b41-125a-49b2-b119-674b65d81253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:11.564665 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1317/2645] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:11.576419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:11.579183 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:11.646904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78960a-2e34-4e4b-a86d-4b4fcbfd6ade service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:11.650732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:11.651341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:11.651622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:11.651895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:11.662298 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:11.663736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:11.673717 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1329/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:13.096945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:13.097454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:13.097555 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:13.137692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] MFA Rules not processed for user `3507362652294e6bb4962902133ad8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:13.139579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:13.149732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1318/2647] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:13.375423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:13.377713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:13.461031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:13.462545 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:13.474371 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68e374-2a64-429b-ba56-2f56e63276dd service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:13.480544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:13.481368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:13.481613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0a887-58ce-4b19-9f12-3cea462981d8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:13.481995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:13.482438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:13.485668 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:13.489025 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:13.489749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:13.490097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:13.490439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] PATH_INFO: `/v3/users/7e3a230224be4212aa18fe752a07bde2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:13.491639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3a230224be4212aa18fe752a07bde2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:13.493814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:13.497270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:13.499392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:13.501313 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:13.514618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1330/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:13.557998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3a230224be4212aa18fe752a07bde2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.566449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3a230224be4212aa18fe752a07bde2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.567052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3a230224be4212aa18fe752a07bde2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.567662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3a230224be4212aa18fe752a07bde2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.581230 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b08e2d12-5bc5-47b9-903e-4bf6ad59a5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3a230224be4212aa18fe752a07bde2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.593881 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1319/2649] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:13 2022] DELETE /identity/v3/users/7e3a230224be4212aa18fe752a07bde2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:13.776702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:13.788801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477774-cad2-4ab8-bf01-c1934303f799 service placement] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:13.862206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:13.869749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:13.870386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:13.870663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:13.870933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] PATH_INFO: `/v3/projects/e6e55bb22dad4294bcaee9c1c5bf0625` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:13.872349 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e55bb22dad4294bcaee9c1c5bf0625)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:13.874286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:13.924809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e55bb22dad4294bcaee9c1c5bf0625', 'request_id': 'req-8ca96825-1312-490a-b55d-c440f11e1483'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.932992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e55bb22dad4294bcaee9c1c5bf0625', 'request_id': 'req-8ca96825-1312-490a-b55d-c440f11e1483'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.939571 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e55bb22dad4294bcaee9c1c5bf0625', 'request_id': 'req-8ca96825-1312-490a-b55d-c440f11e1483'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.950760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] The token cache is being invalidate because project e6e55bb22dad4294bcaee9c1c5bf0625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:13.951047 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.951686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-8ca96825-1312-490a-b55d-c440f11e1483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:13.953810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1331/2650] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:13 2022] DELETE /identity/v3/projects/e6e55bb22dad4294bcaee9c1c5bf0625 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:13.958689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:13.959290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:13.959616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:13.981575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:13.982900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:14.049271 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1320/2651] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:14.057380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.057665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.057938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.077745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:14.078954 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:14.091534 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1332/2652] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:14.092620 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.103001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc6bb-c9fa-4d23-a52d-b9a7c7899bb4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.107518 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.108116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.108386 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.108680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.109528 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:14.109823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.111417 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.123168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1321/2653] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:07:14.128013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.137116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a04b-56eb-4115-8792-5b7c03910652 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.143024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.143636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.143921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.144194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.144901 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.146811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.175240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1333/2654] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:14 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:14.179780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.192269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8316055-d9d0-4e3c-a2f4-356b13826acd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.254207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.254813 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.255089 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.255468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.256110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.258058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.270193 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:14.285690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1322/2655] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:14 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:14.286695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.298002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb63eb6-e38d-46d6-ad47-d00131bee777 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.302910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.303514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.304108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.304390 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.305073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.306678 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.318026 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1334/2656] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:14.321989 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.332572 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1483d9-eb39-44f2-8c1d-6e55a46f0ff1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.337757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.338359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.338638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.338909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.339578 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.341213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c4571-cc16-40cb-bd20-587c02842e9d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.351830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1323/2657] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:14.355947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.366573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24078857-3d8e-42bb-b169-e63eb02e5b51 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.371870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.372738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.373021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.373295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] PATH_INFO: `/v3/projects/69040b5649a349029c052daf3a500059/users/40a3761f193a46068e9ef00a5857e2bb/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.390895 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69040b5649a349029c052daf3a500059, user_id=40a3761f193a46068e9ef00a5857e2bb, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.393610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.407346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1335/2658] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:14 2022] PUT /identity/v3/projects/69040b5649a349029c052daf3a500059/users/40a3761f193a46068e9ef00a5857e2bb/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:14.412501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633252-a229-4c59-80f1-758c021aeeea None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.412850 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633252-a229-4c59-80f1-758c021aeeea None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.413197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61633252-a229-4c59-80f1-758c021aeeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.434267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-61633252-a229-4c59-80f1-758c021aeeea None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:14.435483 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-61633252-a229-4c59-80f1-758c021aeeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:14.497047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1324/2659] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:14.507547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:14.509693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:14.571759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456d0e-5cb6-40f8-9f90-fdfded52db6a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:14.575500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:14.576126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:14.576404 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:14.576700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:14.585951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:14.587374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:14.598444 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1336/2660] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:15.497454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.497998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.497998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.527843 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] MFA Rules not processed for user `40a3761f193a46068e9ef00a5857e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:15.529348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:15.600800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1325/2661] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:15.605491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.616248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566861-7124-4e1d-bd87-15125a664cf5 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.622547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:15.623194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.623541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.623888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.625217 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:15.627387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:15.659117 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1337/2662] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:15 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:15.663073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.678548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b58fa-d85e-4fd3-b93e-57eaf48f5195 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.750311 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:15.751098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.751474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.751878 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.752627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:15.754791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:15.783314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1326/2663] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:15 2022] POST /identity/v3/users => generated 309 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:15.784702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.790730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:15.797317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b3d3-c26b-4a1f-9d7d-cbe2ef3ad48a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.804483 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:15.805213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.805495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.805818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.806436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:15.808120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:15.823716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1338/2664] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:07:15.824924 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.832941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:15.838008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a0ed-48a1-4a3a-a840-cb86fd9d734c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.844371 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:15.845430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.845430 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.845812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] PATH_INFO: `/v3/projects/cd78e98e25ad41a48757bff38b41aaf6/users/6cace6f1f33d4e8bbf621b8e551415aa/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.862570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd78e98e25ad41a48757bff38b41aaf6, user_id=6cace6f1f33d4e8bbf621b8e551415aa, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:15.871567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:15.889446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1327/2665] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:15 2022] PUT /identity/v3/projects/cd78e98e25ad41a48757bff38b41aaf6/users/6cace6f1f33d4e8bbf621b8e551415aa/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:15.894461 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.904766 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce07a-8b26-4ff2-abc9-3d918e47d65f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.963337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:15.964044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:15.964320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:15.964625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:15.965255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:15.966964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743fd83-798f-4fc6-87b3-81181dbfa254 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:15.980075 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1339/2666] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:15.981355 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:15.994039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414220dd-ce96-40c9-8907-2fb5dd13ba44 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:15.999073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:16.000660 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:16.001067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:16.001450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] PATH_INFO: `/v3/projects/cd78e98e25ad41a48757bff38b41aaf6/users/6cace6f1f33d4e8bbf621b8e551415aa/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:16.003599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd78e98e25ad41a48757bff38b41aaf6, user_id=6cace6f1f33d4e8bbf621b8e551415aa, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:16.006742 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:16.029138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1328/2667] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:15 2022] PUT /identity/v3/projects/cd78e98e25ad41a48757bff38b41aaf6/users/6cace6f1f33d4e8bbf621b8e551415aa/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:16.955775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:16.956389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:16.956389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:16.987810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] MFA Rules not processed for user `6cace6f1f33d4e8bbf621b8e551415aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:16.989096 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:17.074005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1340/2668] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:07:18.197463 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:18.267438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386f805-2ac9-40cb-bb75-a235901dbe22 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:18.272277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:18.272928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:18.273208 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:18.273477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] PATH_INFO: `/v3/users/40a3761f193a46068e9ef00a5857e2bb` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:18.274596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a3761f193a46068e9ef00a5857e2bb)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:18.276520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:18.325445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a3761f193a46068e9ef00a5857e2bb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.333272 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a3761f193a46068e9ef00a5857e2bb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.334092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a3761f193a46068e9ef00a5857e2bb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.334705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a3761f193a46068e9ef00a5857e2bb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.346824 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a3761f193a46068e9ef00a5857e2bb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.362683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1329/2669] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:18 2022] DELETE /identity/v3/users/40a3761f193a46068e9ef00a5857e2bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:18.529148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:18.539993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b84ea-508c-45f1-a16a-80794a764321 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:18.599756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:18.600393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:18.600702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:18.600972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] PATH_INFO: `/v3/projects/69040b5649a349029c052daf3a500059` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:18.602074 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69040b5649a349029c052daf3a500059)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:18.603952 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:18.620729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:18.654291 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69040b5649a349029c052daf3a500059', 'request_id': 'req-b8e3fb55-5c59-4ae4-84dc-a9931097a848'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.662655 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69040b5649a349029c052daf3a500059', 'request_id': 'req-b8e3fb55-5c59-4ae4-84dc-a9931097a848'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.668650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69040b5649a349029c052daf3a500059', 'request_id': 'req-b8e3fb55-5c59-4ae4-84dc-a9931097a848'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.680412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] The token cache is being invalidate because project 69040b5649a349029c052daf3a500059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:18.680736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.681397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.682886 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1341/2670] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:18 2022] DELETE /identity/v3/projects/69040b5649a349029c052daf3a500059 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:18.687437 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:18.688987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:18.704001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a29d56-247a-4ddb-af92-74a65038fc5f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:18.748711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:18.763366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:18.763995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:18.764268 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:18.764562 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] PATH_INFO: `/v3/users/6cace6f1f33d4e8bbf621b8e551415aa` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:18.766627 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cace6f1f33d4e8bbf621b8e551415aa)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:18.768571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:18.816360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cace6f1f33d4e8bbf621b8e551415aa'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.823852 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cace6f1f33d4e8bbf621b8e551415aa'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.824453 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cace6f1f33d4e8bbf621b8e551415aa'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.825070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cace6f1f33d4e8bbf621b8e551415aa'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.838181 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-669743e8-fb41-42c5-bb4f-58a06a6ae2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cace6f1f33d4e8bbf621b8e551415aa'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:18.850791 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1330/2671] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:18 2022] DELETE /identity/v3/users/6cace6f1f33d4e8bbf621b8e551415aa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:19.019673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.021120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:19.034403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3fb55-5c59-4ae4-84dc-a9931097a848 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.094158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.094794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.095073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.095344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] PATH_INFO: `/v3/projects/cd78e98e25ad41a48757bff38b41aaf6` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.096465 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd78e98e25ad41a48757bff38b41aaf6)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.098398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.145704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd78e98e25ad41a48757bff38b41aaf6', 'request_id': 'req-d9ad9af7-808e-413b-b905-f694eb09a6ed'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:19.152905 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd78e98e25ad41a48757bff38b41aaf6', 'request_id': 'req-d9ad9af7-808e-413b-b905-f694eb09a6ed'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:19.160021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd78e98e25ad41a48757bff38b41aaf6', 'request_id': 'req-d9ad9af7-808e-413b-b905-f694eb09a6ed'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:19.170988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] The token cache is being invalidate because project cd78e98e25ad41a48757bff38b41aaf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:19.171790 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:19.172921 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d9ad9af7-808e-413b-b905-f694eb09a6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:19.174401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1342/2672] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:19 2022] DELETE /identity/v3/projects/cd78e98e25ad41a48757bff38b41aaf6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:19.179490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.179775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.180049 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.199910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:19.201148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:19.260600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1331/2673] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:19.268389 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.268713 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.268992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.289258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:19.290406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:19.299272 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1343/2674] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:19.303375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.314241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e07ab-e458-4c3e-ac61-d8153017d65b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.318857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.319457 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.319738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.320043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.320740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:19.321045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.322635 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.334315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1332/2675] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:07:19.338433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.348731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b044f-ef66-49e5-ad89-91c09a127488 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.353391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.353979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.354258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.354529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.355158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.357070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.385737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1344/2676] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:19.390519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.400622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fa5f-2626-45ad-b1d0-8cf194a33162 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.449954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:19.460151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.460779 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.461059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.461328 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.461963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.463866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.485151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1333/2677] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:19.489386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.495929 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:19.499656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73edd64-1c4c-4ddf-9446-3e7a440fa029 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.505541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.506293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.506750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.507068 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.507900 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.509712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.519552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1345/2678] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 07:07:19.523720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.534431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2c9f9-c835-4a0e-9db4-4f340583b877 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.538965 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.539605 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.539828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.540098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.540761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.542348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6f2ac-26de-4053-8d12-98db2328a822 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.553462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1334/2679] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:19.557794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.568309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164f2a-880f-4c46-9148-feb03e77495a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.572920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.573566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.573847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.574118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] PATH_INFO: `/v3/projects/5437137bf5264238b958884b81246ab4/users/03c15eb961204de7af420a71f3008945/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.589787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5437137bf5264238b958884b81246ab4, user_id=03c15eb961204de7af420a71f3008945, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.592413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.607446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1346/2680] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:19 2022] PUT /identity/v3/projects/5437137bf5264238b958884b81246ab4/users/03c15eb961204de7af420a71f3008945/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:19.618138 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.618427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.618704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.646401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] MFA Rules not processed for user `03c15eb961204de7af420a71f3008945`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:19.647607 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:19.712802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1335/2681] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:19.717421 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.784227 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906730cb-ff18-457d-a8da-48f40df7f77d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.789011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.789677 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.789903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.790176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.790825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.792750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.821638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1347/2682] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:19.825711 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.838116 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c1188-2663-48fb-8b2f-c52cc06d360c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.898734 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.899472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.899754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.900026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.900744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.902708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.927492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1336/2683] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:19 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:19.931727 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.942255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b7fb-01a0-4dc9-856d-0302633f0689 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.947100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.947697 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.947980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.948256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.948942 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:19.950528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:19.961582 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1348/2684] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:19.965592 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:19.975929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21f4a2-c9c1-4b10-aea8-68700204b0ae admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:19.980446 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:19.981118 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:19.981393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:19.981661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] PATH_INFO: `/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da/users/238651a4b71d4826a02618fff4f9f602/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:19.997084 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d60ef6242ce4e7b8e6b5a83c7e8b0da, user_id=238651a4b71d4826a02618fff4f9f602, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:20.000290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:20.013364 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1337/2685] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:19 2022] PUT /identity/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da/users/238651a4b71d4826a02618fff4f9f602/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:20.018412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:20.032156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ee00-9f90-40ec-b983-18c6626a60d5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:20.089740 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:20.090260 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:20.090538 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:20.090806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:20.091435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:20.093048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1cad2-a927-424b-ba18-b512e052798b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:20.102704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1349/2686] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:20.107016 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:20.117273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e756e1-00a5-4aa9-8eb9-d22025882114 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:20.121886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:20.122606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:20.122797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:20.123064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] PATH_INFO: `/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da/users/238651a4b71d4826a02618fff4f9f602/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:20.125802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d60ef6242ce4e7b8e6b5a83c7e8b0da, user_id=238651a4b71d4826a02618fff4f9f602, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:20.128447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:20.143687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1338/2687] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:20 2022] PUT /identity/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da/users/238651a4b71d4826a02618fff4f9f602/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:20.151708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:20.152008 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:20.152279 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:20.180464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] MFA Rules not processed for user `238651a4b71d4826a02618fff4f9f602`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:20.181739 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:20.214264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:20.256247 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1350/2688] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:20.268360 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:20.270202 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:20.407896 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:20.452159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78003c-28c6-4b2c-a5be-1ee68c9fcf4e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:20.455922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:20.456527 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:20.456833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:20.457102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:20.465950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:20.467380 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b3e9f-a9da-47ef-8d51-2ff8ca96bd97 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:20.476651 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1339/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:20.551853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:20.561539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d24fc-2f30-4e2a-9895-f545c620794a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:20.565308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:20.565896 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:20.566170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:20.566435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:20.621262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:20.622610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8501114-8f46-4def-b8ea-0479f66b51c2 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:20.631596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1351/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:30.472476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=20 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:30.627495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=44 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:43.600687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:43.601195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:43.601195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:43.621496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] MFA Rules not processed for user `7ddba1ca7ae845ecb82b92e8035b9178`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:43.622690 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:43.689908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1340/2691] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:44.020906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d73-6a3b-42c7-904d-e2d7ea595bd6 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:44.021427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d73-6a3b-42c7-904d-e2d7ea595bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:44.021547 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538d73-6a3b-42c7-904d-e2d7ea595bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:44.042100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-15538d73-6a3b-42c7-904d-e2d7ea595bd6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:44.043301 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-15538d73-6a3b-42c7-904d-e2d7ea595bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:44.104611 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1352/2692] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:44.125979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:44.127448 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:44.206738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d20e0-017e-4ec5-a24c-e3f96ef74a40 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:44.212152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:44.212898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:44.213236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:44.213569 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:44.222479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:44.224119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:44.234215 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1341/2693] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:47.089146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:47.089645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:47.089749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:47.117667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:47.118885 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:47.128855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1353/2694] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:47.179166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:47.193920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cbd95-18ed-4052-b999-3c20127c4c45 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:47.199845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:47.200861 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:47.201314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:47.201740 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:47.211897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:47.214724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e8bf3-b483-4fbd-8138-812c6b1a7899 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:47.226377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1342/2695] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:07:50.381273 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:50.391341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:50.391767 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0442f9-e577-4061-9a85-85febf5a4441 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:50.391890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:50.391890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:50.396002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:50.396656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:50.396938 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:50.397211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] PATH_INFO: `/v3/users/03c15eb961204de7af420a71f3008945` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:50.398317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c15eb961204de7af420a71f3008945)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:50.400269 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:50.411234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:50.412421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:50.421149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1343/2696] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:07:50.442452 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:50.443945 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:50.448897 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c15eb961204de7af420a71f3008945'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:50.456974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c15eb961204de7af420a71f3008945'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:50.457648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c15eb961204de7af420a71f3008945'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:50.458305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c15eb961204de7af420a71f3008945'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:50.459710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5e36-8809-49e9-87a3-de7ee7908772 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:50.465359 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:50.465515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b3653dab-6985-4db6-84e3-0deed77274d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c15eb961204de7af420a71f3008945'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:50.465959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:50.466237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:50.466700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:50.468501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:50.479867 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:50.481468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:50.484134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1354/2697] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:50 2022] DELETE /identity/v3/users/03c15eb961204de7af420a71f3008945 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:50.489078 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:50.489367 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:50.489644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:50.491825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1344/2698] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:50.511529 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:50.513712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:50.586528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1355/2699] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:07:50.596769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:50.598155 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:50.660184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5577cd-a6a8-43e6-a7f5-3d8062cdcf8e service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:50.668870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:50.709358 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:50.709992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:50.710270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:50.710539 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:50.720454 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:50.721916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:50.731293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1345/2700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:51.010115 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.011609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.025208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395c3a8-d37e-42a1-852c-5e920b0af3ca None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.029917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.030474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.030755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.031033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] PATH_INFO: `/v3/projects/5437137bf5264238b958884b81246ab4` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.032999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5437137bf5264238b958884b81246ab4)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.035043 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.036720 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:51.083768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5437137bf5264238b958884b81246ab4', 'request_id': 'req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.090812 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5437137bf5264238b958884b81246ab4', 'request_id': 'req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.097210 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5437137bf5264238b958884b81246ab4', 'request_id': 'req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.108428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] The token cache is being invalidate because project 5437137bf5264238b958884b81246ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:51.108749 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.109976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.111620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1356/2701] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:51 2022] DELETE /identity/v3/projects/5437137bf5264238b958884b81246ab4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:51.115601 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.125715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347069-7a96-4198-ab11-7151dd4fe4bc service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.182923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.183552 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.183835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.184090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] PATH_INFO: `/v3/users/238651a4b71d4826a02618fff4f9f602` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.185318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=238651a4b71d4826a02618fff4f9f602)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.187743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.238347 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238651a4b71d4826a02618fff4f9f602'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.246153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238651a4b71d4826a02618fff4f9f602'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.246897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238651a4b71d4826a02618fff4f9f602'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.247614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238651a4b71d4826a02618fff4f9f602'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.262953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-529c505c-8acf-427d-93d3-aafdaf24c25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238651a4b71d4826a02618fff4f9f602'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.276797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1346/2702] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:51 2022] DELETE /identity/v3/users/238651a4b71d4826a02618fff4f9f602 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:51.553141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.554852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.569542 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c24d-baf0-4944-8638-48a8a0b0ab4a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.626446 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.627079 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.627370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.627631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] PATH_INFO: `/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.628893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d60ef6242ce4e7b8e6b5a83c7e8b0da)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.630809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.676361 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d60ef6242ce4e7b8e6b5a83c7e8b0da', 'request_id': 'req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.684440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d60ef6242ce4e7b8e6b5a83c7e8b0da', 'request_id': 'req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.690038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d60ef6242ce4e7b8e6b5a83c7e8b0da', 'request_id': 'req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.701037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] The token cache is being invalidate because project 4d60ef6242ce4e7b8e6b5a83c7e8b0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:51.701321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.702016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:51.704798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1357/2703] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:51 2022] DELETE /identity/v3/projects/4d60ef6242ce4e7b8e6b5a83c7e8b0da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:51.710339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a953c-81a2-4c0b-a2f8-531f233343c2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.710812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a953c-81a2-4c0b-a2f8-531f233343c2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.710908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a953c-81a2-4c0b-a2f8-531f233343c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.731547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-159a953c-81a2-4c0b-a2f8-531f233343c2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:51.732793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-159a953c-81a2-4c0b-a2f8-531f233343c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.761111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.762849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:51.762997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.787487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:51.796829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1347/2704] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:51.805059 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.805336 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.805610 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.825081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:51.825696 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78b691-ed2f-4a56-bfaa-d420643c4fe9 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.826280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.830021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.830732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.831035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.831440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.833423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:51.834700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1348/2705] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:07:51.839363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.849625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a81a5-bfac-47e1-8b97-59d4e56fca63 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.854299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.854898 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.855175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.855441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.856078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:51.856377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.857998 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.869412 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1349/2706] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:07:51.873564 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.884496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa56a99-f1e2-48b1-bedc-7f81f3ded80f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.890134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.891296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.891579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.891844 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.892470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.894373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.903092 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.904526 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:51.914436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1358/2707] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:07:51.925171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1350/2708] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:51.926380 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:51.937157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43573b6d-dd17-4d41-9b17-efc5c9213015 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:51.995993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:51.996623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:51.996908 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:51.997184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:51.997811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:51.999732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.032783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1359/2709] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:51 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:52.036817 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.047479 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9bc6f-97e8-40ce-9c94-0360f231943d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.051933 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.052638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.052985 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.053260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.054224 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.055868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.067121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1351/2710] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:52.071029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.081431 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d7c9d-9967-44e9-a06d-9dc0626c0a47 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.085962 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.086550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.086832 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.087104 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.087743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.089436 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3dd2-c6ee-4bc5-be73-3a1d83df306d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.099566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1360/2711] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:52.103661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.113722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac902-be56-41d2-84fa-53141707ce5c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.118414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.119165 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.119519 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.119793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] PATH_INFO: `/v3/projects/0132e27137dc4c0c84cf0f520aca1a8f/users/75f716b9dfda4ac4b7f5b2dc1a0222f4/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.135566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0132e27137dc4c0c84cf0f520aca1a8f, user_id=75f716b9dfda4ac4b7f5b2dc1a0222f4, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.138450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.153495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1352/2712] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:52 2022] PUT /identity/v3/projects/0132e27137dc4c0c84cf0f520aca1a8f/users/75f716b9dfda4ac4b7f5b2dc1a0222f4/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:52.165118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.165432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.165706 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.194803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] MFA Rules not processed for user `75f716b9dfda4ac4b7f5b2dc1a0222f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:52.196072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:52.239430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:52.263642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1361/2713] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:07:52.268868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.334536 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6732-252f-4de6-a1ec-346bf6068415 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.346314 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.346930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.347210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.347481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.348125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.350096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.391413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.397340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1353/2714] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:52 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:52.404262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9acf86-9303-4436-a061-1f7658135182 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.478264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.478888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.479169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.479493 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.480196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.483295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.530349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.540912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1362/2715] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:52 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:52.542862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef17a88-4842-481a-be5b-06ea945f3b33 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.554442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.555073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.555820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.556669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.557842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.560259 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.577805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.578992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1354/2716] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:52.589093 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4958210-3b6f-4fb5-994c-04d7823bc37d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.594562 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.595236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.595516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.595791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] PATH_INFO: `/v3/projects/0b18cc4ed7e1496e84889c9908c0596b/users/f19c6d5d26324544a1bb7f957d2948bb/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.611854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b18cc4ed7e1496e84889c9908c0596b, user_id=f19c6d5d26324544a1bb7f957d2948bb, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.614600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.636642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1363/2717] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:52 2022] PUT /identity/v3/projects/0b18cc4ed7e1496e84889c9908c0596b/users/f19c6d5d26324544a1bb7f957d2948bb/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:52.640390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.653923 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec1ff4-866d-4b9d-ba01-3b9ebac38c28 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.686139 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:52.714764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.715447 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.715789 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.716122 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.716953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.718589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62cfb-e31a-4c81-99c8-ffe41e8b8616 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.729154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1355/2718] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:52.733314 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.744295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097e542-00a9-4ca7-9d1e-cc01374f0736 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.749003 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:52.749745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.750134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.750503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] PATH_INFO: `/v3/projects/0b18cc4ed7e1496e84889c9908c0596b/users/f19c6d5d26324544a1bb7f957d2948bb/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.752544 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b18cc4ed7e1496e84889c9908c0596b, user_id=f19c6d5d26324544a1bb7f957d2948bb, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:52.755327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:52.766801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1364/2719] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:52 2022] PUT /identity/v3/projects/0b18cc4ed7e1496e84889c9908c0596b/users/f19c6d5d26324544a1bb7f957d2948bb/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:52.776941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:52.777226 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:52.777980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:52.819699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] MFA Rules not processed for user `f19c6d5d26324544a1bb7f957d2948bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:52.821125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:52.909027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1356/2720] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:52.921141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:52.922881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:52.991927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c071a7-7909-40bc-84ef-bab88f69ec74 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:52.999593 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:53.000368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:53.000840 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:53.001250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:53.014423 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:53.017353 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:53.029455 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1365/2721] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:53.112344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:53.123478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00e2f7-687a-4ab5-abaf-dcbfa3da939e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:53.127838 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:53.128613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:53.128984 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:53.129357 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:53.193975 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:53.195666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d0e1f-1d7b-4a19-8558-3f017d5fc44d service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:53.206063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1357/2722] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:53.487845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:53.657591 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:53.684224 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b647cbe-695a-4ef7-bcc9-9e180a1547d8 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:53.689913 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:53.690555 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:53.690834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:53.691103 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] PATH_INFO: `/v3/users/75f716b9dfda4ac4b7f5b2dc1a0222f4` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:53.692228 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f716b9dfda4ac4b7f5b2dc1a0222f4)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:53.694184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:53.747738 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f716b9dfda4ac4b7f5b2dc1a0222f4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:53.762048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f716b9dfda4ac4b7f5b2dc1a0222f4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:53.762657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f716b9dfda4ac4b7f5b2dc1a0222f4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:53.763305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f716b9dfda4ac4b7f5b2dc1a0222f4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:53.771975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f716b9dfda4ac4b7f5b2dc1a0222f4'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:53.789467 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1366/2723] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:53 2022] DELETE /identity/v3/users/75f716b9dfda4ac4b7f5b2dc1a0222f4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:53.793950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:53.794392 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:53.794685 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:53.815431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:53.816677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:53.867784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:53.882265 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1358/2724] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:53.893154 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:53.894777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:53.954868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732454-9900-4540-b9aa-7d98bb3479b5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:53.958623 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:53.959226 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:53.959500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:53.959764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:53.971517 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:53.973173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:53.985138 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1367/2725] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:54.266841 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:54.268315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:54.280436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9825-7617-4a75-bfcf-83f06a444474 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:54.285663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:54.285943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:54.286222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:54.286498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] PATH_INFO: `/v3/projects/0132e27137dc4c0c84cf0f520aca1a8f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:54.287674 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0132e27137dc4c0c84cf0f520aca1a8f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:54.290097 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:54.345056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0132e27137dc4c0c84cf0f520aca1a8f', 'request_id': 'req-cfe01b11-8921-4457-b7fb-8be9fc2c0501'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.351597 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0132e27137dc4c0c84cf0f520aca1a8f', 'request_id': 'req-cfe01b11-8921-4457-b7fb-8be9fc2c0501'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.359865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0132e27137dc4c0c84cf0f520aca1a8f', 'request_id': 'req-cfe01b11-8921-4457-b7fb-8be9fc2c0501'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.372083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] The token cache is being invalidate because project 0132e27137dc4c0c84cf0f520aca1a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:54.372443 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.373203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.374658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1359/2726] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:54 2022] DELETE /identity/v3/projects/0132e27137dc4c0c84cf0f520aca1a8f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:54.379264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:54.390448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccdaba-493e-4888-8550-a17fe454c0f2 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:54.449870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:54.450500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:54.450773 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:54.451042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] PATH_INFO: `/v3/users/f19c6d5d26324544a1bb7f957d2948bb` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:54.452149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19c6d5d26324544a1bb7f957d2948bb)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:54.454754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:54.456275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:54.504169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19c6d5d26324544a1bb7f957d2948bb'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.512987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19c6d5d26324544a1bb7f957d2948bb'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.513753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19c6d5d26324544a1bb7f957d2948bb'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.514362 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19c6d5d26324544a1bb7f957d2948bb'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.522033 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-cbd40191-a6fd-4dd3-a61d-504cef5d1bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19c6d5d26324544a1bb7f957d2948bb'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.540134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1368/2727] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:07:54 2022] DELETE /identity/v3/users/f19c6d5d26324544a1bb7f957d2948bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:54.822735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:54.824167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:54.842456 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01b11-8921-4457-b7fb-8be9fc2c0501 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:54.906966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:54.907825 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:54.908197 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:54.908571 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] PATH_INFO: `/v3/projects/0b18cc4ed7e1496e84889c9908c0596b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:54.910218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b18cc4ed7e1496e84889c9908c0596b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:54.913160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:54.972171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b18cc4ed7e1496e84889c9908c0596b', 'request_id': 'req-e8eff972-7845-4b3b-9786-fefad90495ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.978401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b18cc4ed7e1496e84889c9908c0596b', 'request_id': 'req-e8eff972-7845-4b3b-9786-fefad90495ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.985484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b18cc4ed7e1496e84889c9908c0596b', 'request_id': 'req-e8eff972-7845-4b3b-9786-fefad90495ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.996012 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] The token cache is being invalidate because project 0b18cc4ed7e1496e84889c9908c0596b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:07:54.996299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.996948 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e8eff972-7845-4b3b-9786-fefad90495ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:07:54.998431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1360/2728] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:07:54 2022] DELETE /identity/v3/projects/0b18cc4ed7e1496e84889c9908c0596b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:55.003884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.004342 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.004433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.024162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:55.025397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:55.082700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1369/2729] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:55.091654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.091966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.092237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.106405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:55.112105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:55.114110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:55.122147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1361/2730] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:55.126809 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.136351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818790-7a88-48dc-9ef4-b98c39506fef None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.141418 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.142108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.142355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.142618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.143280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:07:55.143575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.145173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.156343 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1370/2731] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:07:55.160664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.169626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ffd7-ce7b-483b-acff-8eefb2a8dbc3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.174897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.175486 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.175761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.176031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.176693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.178574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.206986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1362/2732] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:55.210984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.221441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cfef8-5701-4438-87f6-7bf1122929a5 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.278977 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.279708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.279987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.280257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.280917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.282813 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.293466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:55.306401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1371/2733] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:07:55.310264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.321073 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b90cd-677a-4c81-83c1-76d67beab8b9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.325570 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141351-d374-427d-8727-b30a69335edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.326153 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141351-d374-427d-8727-b30a69335edc admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.326423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141351-d374-427d-8727-b30a69335edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.326687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141351-d374-427d-8727-b30a69335edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.327317 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141351-d374-427d-8727-b30a69335edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.328955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141351-d374-427d-8727-b30a69335edc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.338535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1363/2734] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:55.342299 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.352488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6bccc-9c14-482a-bda7-fb27efea9e41 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.356992 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.357576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.357853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.358122 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.358759 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.361306 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03bdd4-36d5-494c-89f4-e6fdc5224493 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.371599 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1372/2735] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:55.375952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141351-d374-427d-8727-b30a69335edc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.385728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141351-d374-427d-8727-b30a69335edc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.391879 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.392542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.392865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.393132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] PATH_INFO: `/v3/projects/35b2d6376350403987411db77141a45f/users/017c9f17d171409dbddb32926838f600/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.408530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b2d6376350403987411db77141a45f, user_id=017c9f17d171409dbddb32926838f600, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.411209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.441485 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1364/2736] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:55 2022] PUT /identity/v3/projects/35b2d6376350403987411db77141a45f/users/017c9f17d171409dbddb32926838f600/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:07:55.443149 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.443434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.443724 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.473233 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] MFA Rules not processed for user `017c9f17d171409dbddb32926838f600`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:55.474514 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:55.539422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1373/2737] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:55.543807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.605745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab99b3b-ad9a-488c-85e3-e7ee27e1f368 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.611680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.612276 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.612553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.612853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.613478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.615362 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.642093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1365/2738] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:55.646059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.656541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4030b-1e64-4f5f-9b76-676b93507709 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.712286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.712879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.713157 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.713425 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.714056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.715939 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.737238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1374/2739] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:07:55.741299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.751961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0c58-c633-417b-9658-83efacf1b68a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.756493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.757121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.757396 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.757666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.758331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.759908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.770748 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1366/2740] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:55.774747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.784990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5727-9c1f-42b1-bc00-51428a401e55 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.789745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.790332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.790610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.790881 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] PATH_INFO: `/v3/projects/a1ab0c23966c42a7b059f274a7825fca/users/39338790632b4223bd9f71f3ef8a9310/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.806311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ab0c23966c42a7b059f274a7825fca, user_id=39338790632b4223bd9f71f3ef8a9310, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.808963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.822129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1375/2741] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:55 2022] PUT /identity/v3/projects/a1ab0c23966c42a7b059f274a7825fca/users/39338790632b4223bd9f71f3ef8a9310/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:55.826046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.837366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efd169-d939-450b-994d-9544f8060d6a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.894465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.895067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.895345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.895609 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.896234 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.897834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30953b28-3817-40b1-8c16-69ddf875bc83 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.907691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1367/2742] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:07:55.911874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:55.922612 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb8b6-08e3-41cf-a56f-370fa115def4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:55.927350 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:55.927998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.928275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.928601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] PATH_INFO: `/v3/projects/a1ab0c23966c42a7b059f274a7825fca/users/39338790632b4223bd9f71f3ef8a9310/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.930847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ab0c23966c42a7b059f274a7825fca, user_id=39338790632b4223bd9f71f3ef8a9310, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:55.933512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:55.944218 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1376/2743] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:07:55 2022] PUT /identity/v3/projects/a1ab0c23966c42a7b059f274a7825fca/users/39338790632b4223bd9f71f3ef8a9310/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:07:55.955151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e4fd-4a1c-4223-859e-4432fda7cf61 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:55.955438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e4fd-4a1c-4223-859e-4432fda7cf61 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:55.955708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e4fd-4a1c-4223-859e-4432fda7cf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:55.980842 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:55.984166 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0cf3e4fd-4a1c-4223-859e-4432fda7cf61 None None] MFA Rules not processed for user `39338790632b4223bd9f71f3ef8a9310`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:55.987269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0cf3e4fd-4a1c-4223-859e-4432fda7cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:56.058344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1368/2744] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:07:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:56.069673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:56.071656 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:56.103170 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:07:56.131996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156f63-1381-4acd-a1c7-ea7a6a4982b7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:07:56.135745 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:07:56.136340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:56.136643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:56.136916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:56.191112 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:07:56.192535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:07:56.201163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1377/2745] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:07:59.794167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:07:59.794691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:07:59.794810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:07:59.817258 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:07:59.818534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:07:59.883999 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1369/2746] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:07:59.927880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:07:59.934429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:00.004259 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdec149-8979-4de7-898a-4f0f24c1cc0b service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:00.009910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:00.010520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:00.010800 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:00.011100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:00.019779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:00.021395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:00.030781 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1378/2747] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:08:00.512895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:00.532047 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac937c83-dada-4970-98a2-7806785fa40c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:00.538211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:00.538851 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:00.539132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:00.539404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:00.554684 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:00.556553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b229df6-d325-4702-b27f-b195e4703717 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:00.570594 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1370/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:03.055415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:03.057018 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:03.116744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ede6-86e5-4a1f-85f9-eb34ec6558fa service nova] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:03.120442 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:03.121072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:03.121347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:03.121620 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:03.123348 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:03.136937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:03.138386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:03.148945 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1379/2749] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:03.902870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:03.903405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:03.903405 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:03.928546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:03.930026 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:03.938087 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1371/2750] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:03.961414 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:03.977288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c32f-e762-43e4-ba5e-deda356499e3 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:03.983277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:03.983906 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:03.984854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:03.985130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:03.997485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:04.000550 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:04.000971 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa47dc-daea-402e-a6b0-168689460db4 service nova] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:04.017158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1380/2751] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:08:05.600194 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:05.610491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11d84f-acad-4c31-a4bd-16e5e9e5b6c4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:05.615490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:05.616017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:05.616291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:05.616559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] PATH_INFO: `/v3/users/017c9f17d171409dbddb32926838f600` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:05.617765 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] RBAC: Authorizing `identity:delete_user(user_id=017c9f17d171409dbddb32926838f600)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:05.619733 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:05.681744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017c9f17d171409dbddb32926838f600'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:05.691669 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017c9f17d171409dbddb32926838f600'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:05.692941 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017c9f17d171409dbddb32926838f600'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:05.693496 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017c9f17d171409dbddb32926838f600'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:05.707664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017c9f17d171409dbddb32926838f600'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:05.710589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:05.732967 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1372/2752] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:05 2022] DELETE /identity/v3/users/017c9f17d171409dbddb32926838f600 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:05.738428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:05.738902 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:05.739200 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:05.762625 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:05.763988 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:05.846860 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1381/2753] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:05.860140 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:05.861952 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:05.922278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322539b-21c6-4a38-ab6a-673e13d2550b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:05.925717 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:05.926390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:05.926743 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:05.928325 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:05.937423 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:05.939095 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:05.950478 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1373/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:06.356345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:06.358094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:06.385434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da9cfc-699f-4c2f-b02a-1f2f0989d0f1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:06.393709 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:06.397001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:06.397469 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:06.397814 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] PATH_INFO: `/v3/projects/35b2d6376350403987411db77141a45f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:06.399130 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b2d6376350403987411db77141a45f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:06.401329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:06.462202 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b2d6376350403987411db77141a45f', 'request_id': 'req-1af629ef-6913-4b69-8001-1f2a678df985'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.475080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b2d6376350403987411db77141a45f', 'request_id': 'req-1af629ef-6913-4b69-8001-1f2a678df985'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.482089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b2d6376350403987411db77141a45f', 'request_id': 'req-1af629ef-6913-4b69-8001-1f2a678df985'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.496986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] The token cache is being invalidate because project 35b2d6376350403987411db77141a45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:06.497357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.498084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.502032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1382/2755] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:06 2022] DELETE /identity/v3/projects/35b2d6376350403987411db77141a45f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:06.506005 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:06.517146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec70e9c-26a0-4911-94fc-31053b5ba7bc service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:06.586689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:06.587236 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:06.587509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:06.587775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] PATH_INFO: `/v3/users/39338790632b4223bd9f71f3ef8a9310` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:06.588997 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39338790632b4223bd9f71f3ef8a9310)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:06.590940 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:06.641074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39338790632b4223bd9f71f3ef8a9310'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.648951 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39338790632b4223bd9f71f3ef8a9310'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.649563 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39338790632b4223bd9f71f3ef8a9310'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.650162 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39338790632b4223bd9f71f3ef8a9310'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.663023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-47ffda39-dd45-4d67-95b5-9041325b9409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39338790632b4223bd9f71f3ef8a9310'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:06.676339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1374/2756] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:06 2022] DELETE /identity/v3/users/39338790632b4223bd9f71f3ef8a9310 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:08:06.971385 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:06.972915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:06.991847 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af629ef-6913-4b69-8001-1f2a678df985 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.074379 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.075057 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.075340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.075642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] PATH_INFO: `/v3/projects/a1ab0c23966c42a7b059f274a7825fca` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.076831 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ab0c23966c42a7b059f274a7825fca)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.079690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.105752 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:07.131255 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ab0c23966c42a7b059f274a7825fca', 'request_id': 'req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:07.135899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.136254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.136638 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.141000 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ab0c23966c42a7b059f274a7825fca', 'request_id': 'req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:07.147673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ab0c23966c42a7b059f274a7825fca', 'request_id': 'req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:07.158415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:07.159704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.160169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] The token cache is being invalidate because project a1ab0c23966c42a7b059f274a7825fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:07.160307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:07.161044 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-54f733cc-dd66-4bd2-bcfe-f8ed6ff26376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:07.162961 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1383/2757] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:06 2022] DELETE /identity/v3/projects/a1ab0c23966c42a7b059f274a7825fca => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:07.168650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8205ba-eae6-479b-b01f-83ff2bb07410 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.168928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8205ba-eae6-479b-b01f-83ff2bb07410 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.169197 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8205ba-eae6-479b-b01f-83ff2bb07410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.173150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:07.191023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-cc8205ba-eae6-479b-b01f-83ff2bb07410 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:07.192284 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cc8205ba-eae6-479b-b01f-83ff2bb07410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.229241 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1375/2758] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:08:07.249759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.251144 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.264204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1384/2759] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:08:07.266644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.266927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.267199 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.289650 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:07.290944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.306966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1385/2760] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:07.308443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.318654 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7813-65ae-46f0-83c0-119ebffef3ad None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.323474 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.324083 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.324363 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.324789 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.325748 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:08:07.326076 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.327764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.339503 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1386/2761] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:08:07.344323 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.351439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddc94f-b628-4e0e-8d13-d06d6818b0da None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.357203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.357828 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.358111 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.358390 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.361991 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa7d-bbc1-4275-919e-436c59a82fa4 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.367613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.368609 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.369146 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.370180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.371300 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.372010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.373498 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.373656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.384793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1376/2762] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 07:08:07.425153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1387/2763] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:08:07.429315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.440977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635fbda-d249-4d0d-afd8-97763f153743 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.513662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.514385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.514737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.515070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.516606 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.518626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.547031 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1377/2764] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:08:07.551327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.563407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8de16-4313-400e-bce4-0fdceecd6c83 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.568179 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.568818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.569091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.569360 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.569996 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.571584 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.585775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1388/2765] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:08:07.586775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.598769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafa55d-8c63-4198-b600-70c7ea720239 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.603548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.604127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.604401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.604693 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.605756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.606914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389212db-e0a1-4e6b-803a-d91b375345b6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.617802 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1378/2766] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:08:07.622037 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.632688 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c978a1-ecef-419f-90fb-f23df8160a0a admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.637253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.637907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.638180 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.638447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] PATH_INFO: `/v3/projects/1d4803b8fa64470c8f03a07df0175f84/users/219fdb8b3fc848439de6355324e57e1e/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.653466 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4803b8fa64470c8f03a07df0175f84, user_id=219fdb8b3fc848439de6355324e57e1e, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.656124 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.669676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1389/2767] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:08:07 2022] PUT /identity/v3/projects/1d4803b8fa64470c8f03a07df0175f84/users/219fdb8b3fc848439de6355324e57e1e/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:07.680959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.681442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.681565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.710670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] MFA Rules not processed for user `219fdb8b3fc848439de6355324e57e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:07.711877 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.716947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:07.783395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1379/2768] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:07.794447 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.796162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:07.831743 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:07.856280 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a340c-27d4-4282-ad6b-cf517d92056e admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.859984 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.860604 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.860889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.861160 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.869512 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.870935 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979afc7-8c13-498c-a9d2-a6c7cac24d68 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:07.881633 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1390/2769] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:07.907450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:07.975854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d09978-0a54-43c8-b32a-0b85105fd973 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:07.982710 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:07.983348 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:07.983622 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:07.983950 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] PATH_INFO: `/v3/users/219fdb8b3fc848439de6355324e57e1e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:07.985212 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219fdb8b3fc848439de6355324e57e1e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:07.987164 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:08.046192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219fdb8b3fc848439de6355324e57e1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.055640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219fdb8b3fc848439de6355324e57e1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.056375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219fdb8b3fc848439de6355324e57e1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.057216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219fdb8b3fc848439de6355324e57e1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.073023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219fdb8b3fc848439de6355324e57e1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.089245 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1380/2770] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:07 2022] DELETE /identity/v3/users/219fdb8b3fc848439de6355324e57e1e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:08.097338 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.097850 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.098225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.134600 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:08.138159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:08.207229 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1391/2771] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:08.217960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:08.220056 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:08.276023 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:08.317883 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6d4a-b8ab-466c-8b9a-7fa3b6ab2995 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:08.323297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:08.324045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.324701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.325188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.336830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:08.338414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c970c-2a97-4c23-bde7-562310f32b50 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:08.350757 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1381/2772] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:08.667915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:08.670822 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:08.689810 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8e976-f667-4d9a-a008-52716353a035 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:08.695590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:08.696234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.696533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.696835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] PATH_INFO: `/v3/projects/1d4803b8fa64470c8f03a07df0175f84` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.697967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4803b8fa64470c8f03a07df0175f84)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:08.699859 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:08.759110 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4803b8fa64470c8f03a07df0175f84', 'request_id': 'req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.771240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4803b8fa64470c8f03a07df0175f84', 'request_id': 'req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.779974 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4803b8fa64470c8f03a07df0175f84', 'request_id': 'req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.793335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] The token cache is being invalidate because project 1d4803b8fa64470c8f03a07df0175f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:08.793622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.794268 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5fc26fcf-a123-4301-a1ce-c8fcb274b59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:08.795771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1392/2773] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:08 2022] DELETE /identity/v3/projects/1d4803b8fa64470c8f03a07df0175f84 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:08.800946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.801415 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.801663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.822184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:08.823363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:08.885046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1382/2774] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:08.893287 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.893565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.893834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.914206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:08.915430 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:08.942448 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1393/2775] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:08.944744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:08.955905 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583f5f-ec1a-4889-a359-9467f53eaf12 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:08.961019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:08.961642 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:08.961917 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:08.962185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:08.962835 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:08:08.964672 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:08.965003 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:08.979598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1383/2776] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:08:08.983792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.000490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255a56-f824-4a96-976f-ec11aa55c6b1 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.020554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.021419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.021841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.022289 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.023084 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.025675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.068422 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1394/2777] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:08:08 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:08:09.073646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.095708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904a2cf-263e-4744-9fbd-11bb5fa14997 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.176641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.177363 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.177641 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.177911 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.178534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.180719 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.206146 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1384/2778] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:08:09 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:08:09.209815 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.220653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7985ba-3912-47c9-9433-a7a963d71133 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.225999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.226839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.227295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.227564 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.228240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.229852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.242872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1395/2779] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:08:09.247822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.259980 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba291d-ac02-48ba-b35f-63a979654e43 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.265637 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.266318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.266600 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.266873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.267579 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.269286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66cfee-b22c-40dd-9008-bf0d76f48ab5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.282671 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1385/2780] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:08:09.286858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.299485 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d17f-f63c-47ae-bd3f-c17b12070f97 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.305731 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.306408 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.306686 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.306966 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] PATH_INFO: `/v3/projects/08e8db90f8314bfa8a2c580ad8b6cccc/users/aff703ca3eff4bec9733660fc8f30c12/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.329546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e8db90f8314bfa8a2c580ad8b6cccc, user_id=aff703ca3eff4bec9733660fc8f30c12, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.332855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.336943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:09.358651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1396/2781] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:08:09 2022] PUT /identity/v3/projects/08e8db90f8314bfa8a2c580ad8b6cccc/users/aff703ca3eff4bec9733660fc8f30c12/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:09.434626 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.434906 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.435614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.468769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] MFA Rules not processed for user `aff703ca3eff4bec9733660fc8f30c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:09.470117 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:09.494922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:09.544254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1386/2782] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:09.556985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.559007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:09.621326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49c01f-f5c3-499c-9e34-eac5dce97cd7 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:09.625602 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:09.626206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:09.626481 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:09.626747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:09.636232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:09.637675 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:09.646844 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1397/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:09.919206 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:09.920854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:09.999102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3b33f-56fb-443d-b2d7-b396fa5af984 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:10.004715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:10.005366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:10.005649 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:10.005919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] PATH_INFO: `/v3/users/f96b57f91667443c9ee3fdfd3cffeb7c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:10.007065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96b57f91667443c9ee3fdfd3cffeb7c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:10.009052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:10.065505 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96b57f91667443c9ee3fdfd3cffeb7c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.074211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96b57f91667443c9ee3fdfd3cffeb7c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.075900 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96b57f91667443c9ee3fdfd3cffeb7c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.076500 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96b57f91667443c9ee3fdfd3cffeb7c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.089978 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96b57f91667443c9ee3fdfd3cffeb7c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.103034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1387/2784] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:09 2022] DELETE /identity/v3/users/f96b57f91667443c9ee3fdfd3cffeb7c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:10.282804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:10.295601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046baa3-f4db-4105-8aec-33a34be4d1bc service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:10.363937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:10.364956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:10.364956 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:10.365341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] PATH_INFO: `/v3/projects/7de1021fb2a4458ca54e04e21abc32cd` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:10.366568 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de1021fb2a4458ca54e04e21abc32cd)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:10.368833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:10.424804 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de1021fb2a4458ca54e04e21abc32cd', 'request_id': 'req-274bffeb-6640-4747-bdc2-25c2c07a2764'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.440910 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de1021fb2a4458ca54e04e21abc32cd', 'request_id': 'req-274bffeb-6640-4747-bdc2-25c2c07a2764'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.447415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de1021fb2a4458ca54e04e21abc32cd', 'request_id': 'req-274bffeb-6640-4747-bdc2-25c2c07a2764'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.459735 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] The token cache is being invalidate because project 7de1021fb2a4458ca54e04e21abc32cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:10.460055 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.460755 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.462225 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1398/2785] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:10 2022] DELETE /identity/v3/projects/7de1021fb2a4458ca54e04e21abc32cd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:10.466119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:10.467494 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:10.481397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4974-381b-4eaf-b9d4-17f277b9a7cb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:10.525038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:10.540793 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:10.541419 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:10.541694 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:10.541962 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] PATH_INFO: `/v3/users/10d219c8126e486fbf7881246c15f36d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:10.543079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d219c8126e486fbf7881246c15f36d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:10.545001 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:10.591434 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d219c8126e486fbf7881246c15f36d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.598590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d219c8126e486fbf7881246c15f36d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.599246 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d219c8126e486fbf7881246c15f36d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.599857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d219c8126e486fbf7881246c15f36d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.612231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d219c8126e486fbf7881246c15f36d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.624445 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1388/2786] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:10 2022] DELETE /identity/v3/users/10d219c8126e486fbf7881246c15f36d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:10.795978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:10.799246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:10.814684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bffeb-6640-4747-bdc2-25c2c07a2764 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:10.854025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:10.897192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:10.897837 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:10.898118 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:10.898392 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] PATH_INFO: `/v3/projects/ee636ff930044ba39e3774267562f137` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:10.899543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee636ff930044ba39e3774267562f137)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:10.901533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:10.953983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee636ff930044ba39e3774267562f137', 'request_id': 'req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.960937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee636ff930044ba39e3774267562f137', 'request_id': 'req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.967295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee636ff930044ba39e3774267562f137', 'request_id': 'req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.978904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] The token cache is being invalidate because project ee636ff930044ba39e3774267562f137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:10.979196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.979841 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2ca084e3-0a6d-4ee0-b696-04e45f8fccc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:10.981374 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1399/2787] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:10 2022] DELETE /identity/v3/projects/ee636ff930044ba39e3774267562f137 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:19.822331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:19.823783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:19.836713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cb0ef-1371-4db9-8c22-2280330fd7c0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:19.894910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:19.895774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:19.896048 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:19.896313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] PATH_INFO: `/v3/users/aff703ca3eff4bec9733660fc8f30c12` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:19.897465 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff703ca3eff4bec9733660fc8f30c12)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:19.899385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:19.947775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff703ca3eff4bec9733660fc8f30c12'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:19.956112 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff703ca3eff4bec9733660fc8f30c12'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:19.956815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff703ca3eff4bec9733660fc8f30c12'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:19.957429 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff703ca3eff4bec9733660fc8f30c12'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:19.965784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:19.976280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff703ca3eff4bec9733660fc8f30c12'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:19.990720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1389/2788] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:08:19 2022] DELETE /identity/v3/users/aff703ca3eff4bec9733660fc8f30c12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:19.995168 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:19.995681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:19.995681 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:20.017238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:20.018643 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:20.085203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1400/2789] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:20.095470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:20.096921 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:20.154795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e38b5-e921-4027-bcde-f950a43a5b98 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:20.158931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:20.159553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:20.159803 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:20.160072 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:20.168866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:20.170331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c3355-1888-4ab6-8db7-fe5e6539fa13 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:20.180761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1390/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:20.448443 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:20.449888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:20.461722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78ce02-f504-43ce-b66e-e65a2cda3bdc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:20.466310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:20.466934 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:20.467207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:20.467472 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] PATH_INFO: `/v3/projects/08e8db90f8314bfa8a2c580ad8b6cccc` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:20.469129 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e8db90f8314bfa8a2c580ad8b6cccc)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:20.471010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:20.517345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e8db90f8314bfa8a2c580ad8b6cccc', 'request_id': 'req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:20.520776 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:20.524426 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e8db90f8314bfa8a2c580ad8b6cccc', 'request_id': 'req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:20.530980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e8db90f8314bfa8a2c580ad8b6cccc', 'request_id': 'req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:20.542904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] The token cache is being invalidate because project 08e8db90f8314bfa8a2c580ad8b6cccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:08:20.543190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:20.543833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c35817d6-9c36-43db-9f7e-1e4ba8ce9e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:08:20.545356 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1401/2791] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:08:20 2022] DELETE /identity/v3/projects/08e8db90f8314bfa8a2c580ad8b6cccc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:08:22.316267 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:22.316797 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:22.316902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:22.335492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] MFA Rules not processed for user `3507362652294e6bb4962902133ad8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:22.336713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:22.390481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1391/2792] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:30.539948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:32.384070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=58,keystone:DELETE=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:35.432368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c042-72b6-4c00-9427-9ef42d178248 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:35.432955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c042-72b6-4c00-9427-9ef42d178248 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:35.432955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c042-72b6-4c00-9427-9ef42d178248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:35.509453 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-3616c042-72b6-4c00-9427-9ef42d178248 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:35.510660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-3616c042-72b6-4c00-9427-9ef42d178248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:35.610331 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1402/2793] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:35.634391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:35.635836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:35.776658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80be71f-2190-4414-b3e1-60cd1694e8de None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:35.782092 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:35.782916 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:35.783192 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:35.783462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:35.791640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:35.793232 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:35.802780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1392/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:38.969163 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6523e-70a6-484d-9a78-b61c0530bef7 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:38.969704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6523e-70a6-484d-9a78-b61c0530bef7 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:38.969704 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6523e-70a6-484d-9a78-b61c0530bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:38.989598 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-afc6523e-70a6-484d-9a78-b61c0530bef7 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:38.990788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-afc6523e-70a6-484d-9a78-b61c0530bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:38.998501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1403/2795] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:39.019556 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:39.031022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798952a3-9137-4968-bd5b-61cdffdbd286 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:39.037395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:39.037988 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:39.038266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:39.038535 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:39.046598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:39.048689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:39.058148 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1393/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:41.818642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71471477-5a96-4c0a-af64-132dd220df46 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:41.818642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71471477-5a96-4c0a-af64-132dd220df46 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:41.819204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71471477-5a96-4c0a-af64-132dd220df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:41.839857 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-71471477-5a96-4c0a-af64-132dd220df46 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:41.841960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-71471477-5a96-4c0a-af64-132dd220df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:41.850826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1404/2797] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:41.872342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:41.873805 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:41.888946 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb54aa1-3391-4315-85f8-5cfadbbc640e service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:41.894687 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:41.895281 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:41.895558 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:41.895827 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:41.904397 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:41.906002 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:41.916735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1394/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:44.995325 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23957bf-6176-4ba4-8daf-56fe38377419 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:44.995856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23957bf-6176-4ba4-8daf-56fe38377419 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:44.995856 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23957bf-6176-4ba4-8daf-56fe38377419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:45.014835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-f23957bf-6176-4ba4-8daf-56fe38377419 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:45.016020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-f23957bf-6176-4ba4-8daf-56fe38377419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:45.024651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1405/2799] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:45.046468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:45.058490 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564835-e338-415f-a74a-c45ef57ebd03 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:45.063888 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:45.064468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:45.064774 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:45.065044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:45.073461 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:45.075022 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:45.085278 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1395/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:49.231797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a52b6-0bb8-4829-9446-7e7513a8c250 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:49.231797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a52b6-0bb8-4829-9446-7e7513a8c250 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:49.231797 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a52b6-0bb8-4829-9446-7e7513a8c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:49.259993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-506a52b6-0bb8-4829-9446-7e7513a8c250 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:49.261278 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-506a52b6-0bb8-4829-9446-7e7513a8c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:49.271013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1406/2801] 10.222.0.43 () {58 vars in 1016 bytes} [Tue Sep 13 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:49.293353 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:49.307341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197c197-10b1-478e-9b17-dd71c2db53ae service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:49.314033 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b732fb0cfa4749c3a1e96639ff69e9f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:49.314929 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:49.315391 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:49.315829 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:49.326705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:49.328442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:49.339862 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1396/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:08:51.128317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:51.128907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:51.128907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:51.148001 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] MFA Rules not processed for user `7ddba1ca7ae845ecb82b92e8035b9178`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:08:51.149262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:51.185817 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=100 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:51.203054 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1407/2803] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:08:52.281220 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:08:52.282656 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:52.311780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:08:52.378537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d240-4f82-44fc-a813-4eb1d5661a26 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:08:52.383771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:08:52.384375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:08:52.384680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:08:52.384954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:08:52.386689 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:08:52.398401 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:08:52.399964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:08:52.411132 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1397/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:08:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:01.196708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=6 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:02.406613 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=30 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:18.513732 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:18.525506 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1231e-6474-40c5-bc59-ba62969a7808 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:18.530463 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:18.530994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:18.531267 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:18.531533 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:18.533240 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:18.545691 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:18.547258 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:18.559016 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1408/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:09:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:18.570728 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:18.572747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:18.593826 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756fb0-8d20-460e-9149-7e96af0fb8e7 service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:18.598747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:18.599853 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:18.600128 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:18.600379 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] PATH_INFO: `/v3/users/3507362652294e6bb4962902133ad8ce` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:18.601523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3507362652294e6bb4962902133ad8ce)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:18.603416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:18.649875 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3507362652294e6bb4962902133ad8ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.657493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3507362652294e6bb4962902133ad8ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.658198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3507362652294e6bb4962902133ad8ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.658796 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3507362652294e6bb4962902133ad8ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.671404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-49d3d001-02c9-4d21-9808-bdc97c3cba04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3507362652294e6bb4962902133ad8ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.684081 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1398/2806] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:09:18 2022] DELETE /identity/v3/users/3507362652294e6bb4962902133ad8ce => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:18.856872 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:18.868892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817a05-c905-41a8-a432-9e83abf6db40 service placement] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:18.924357 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:18.925013 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:18.925286 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:18.925552 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] PATH_INFO: `/v3/projects/2a0b76996f3a425fa3486174c155bf14` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:18.926659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0b76996f3a425fa3486174c155bf14)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:18.929087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:18.975970 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0b76996f3a425fa3486174c155bf14', 'request_id': 'req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.983065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0b76996f3a425fa3486174c155bf14', 'request_id': 'req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.988592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0b76996f3a425fa3486174c155bf14', 'request_id': 'req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:18.999950 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] The token cache is being invalidate because project 2a0b76996f3a425fa3486174c155bf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:09:19.000238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:19.000874 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-ebf90b69-50ec-4758-b5f3-84e83fe22d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:19.002332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1409/2807] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:09:18 2022] DELETE /identity/v3/projects/2a0b76996f3a425fa3486174c155bf14 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:19.007449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.007735 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.008006 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.028218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:19.029438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:19.088623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1399/2808] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:19.096169 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.096480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.096783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.117554 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:19.118784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:19.126541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1410/2809] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:19.130833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.140346 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2cc64-f344-4d81-b238-41352ebdc44f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.144887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.145481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.145761 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.146071 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.146713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:09:19.147041 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.148786 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.160738 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1400/2810] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:09:19.166023 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.175203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22561c-473f-4ac9-a571-e9731be98c7e None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.180963 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.181553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.181828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.182095 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.182730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.184699 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.211187 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1411/2811] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:09:19 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:19.215495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.226639 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9ed25-4f6b-470d-8863-be0145aa9854 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.282460 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.283062 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.283342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.283616 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.284280 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.286306 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.294767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:19.309266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1401/2812] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:09:19 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:19.314035 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.327090 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43f811-e7ac-4ed8-84b5-ad5979181616 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.331791 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.332397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.332712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.332985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.333659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.335327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.345214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1412/2813] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:19.349724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.360028 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991d274-947b-4d66-928b-5a593ec316ab admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.364557 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.366290 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.366567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.366839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.367475 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.369085 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66de60-0dd7-4889-bd76-ec2e08890ec4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.379482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1402/2814] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:19.383459 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.393288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869664dd-9001-417c-841b-542df9f67e40 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.398329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.398968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.399246 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.399518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] PATH_INFO: `/v3/projects/3ea630ae7b9a499f9b5aa3662043464e/users/e1115af3726d440ca7e50a32eff8dd54/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.415308 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea630ae7b9a499f9b5aa3662043464e, user_id=e1115af3726d440ca7e50a32eff8dd54, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.417973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.431825 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1413/2815] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:09:19 2022] PUT /identity/v3/projects/3ea630ae7b9a499f9b5aa3662043464e/users/e1115af3726d440ca7e50a32eff8dd54/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:19.441974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.442260 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.442533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.471292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] MFA Rules not processed for user `e1115af3726d440ca7e50a32eff8dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:19.472484 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:19.535172 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1403/2816] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:19.546336 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:19.548111 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:19.566184 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:19.633826 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f86d-bfc8-4e47-96e0-d42720f0b898 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:19.637401 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:19.637997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:19.638277 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:19.638546 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:19.646821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:19.648234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5019f9-5d5b-4730-961d-df3b7219df66 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:19.656836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1414/2817] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:09:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:24.638184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:24.701185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a695ed-057a-4d64-a9d2-56fa101c7606 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:24.705598 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:24.706211 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:24.706482 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:24.706746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] PATH_INFO: `/v3/users/e1115af3726d440ca7e50a32eff8dd54` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:24.707839 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1115af3726d440ca7e50a32eff8dd54)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:24.710020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:24.755294 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1115af3726d440ca7e50a32eff8dd54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:24.763100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1115af3726d440ca7e50a32eff8dd54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:24.763736 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1115af3726d440ca7e50a32eff8dd54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:24.764377 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1115af3726d440ca7e50a32eff8dd54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:24.775866 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:24.777141 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1115af3726d440ca7e50a32eff8dd54'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:24.791416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1404/2818] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:09:24 2022] DELETE /identity/v3/users/e1115af3726d440ca7e50a32eff8dd54 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:24.795870 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:24.796368 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:24.796468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:24.816627 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:24.817820 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:24.875793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1415/2819] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:24.886307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:24.887730 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:24.965943 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb055b23-8923-4193-9ce3-ff64efe0029e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:24.969553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:24.970154 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:24.970431 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:24.970701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:24.979602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:24.981064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:24.991110 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1405/2820] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:25.259663 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:25.261223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:25.275892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd732a9-0c57-4771-9338-6f95998206a0 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:25.280504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:25.281192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:25.281596 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:25.281710 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] PATH_INFO: `/v3/projects/3ea630ae7b9a499f9b5aa3662043464e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:25.282995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea630ae7b9a499f9b5aa3662043464e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:25.284914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:25.333061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea630ae7b9a499f9b5aa3662043464e', 'request_id': 'req-a48288d5-63ce-44c7-bc2c-1e1024204652'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:25.340451 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea630ae7b9a499f9b5aa3662043464e', 'request_id': 'req-a48288d5-63ce-44c7-bc2c-1e1024204652'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:25.345920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea630ae7b9a499f9b5aa3662043464e', 'request_id': 'req-a48288d5-63ce-44c7-bc2c-1e1024204652'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:25.357470 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] The token cache is being invalidate because project 3ea630ae7b9a499f9b5aa3662043464e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:09:25.357760 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:25.358387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:25.359855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1416/2821] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:09:25 2022] DELETE /identity/v3/projects/3ea630ae7b9a499f9b5aa3662043464e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:34.986210 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=41 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:35.354507 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:57.640381 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:57.641886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:57.656551 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc2c7-9dc8-4be3-af64-9324056cf39e service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:57.713093 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:57.713646 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:57.713920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:57.714184 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] PATH_INFO: `/v3/users/7ddba1ca7ae845ecb82b92e8035b9178` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:57.715293 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddba1ca7ae845ecb82b92e8035b9178)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:57.717237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:57.764133 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddba1ca7ae845ecb82b92e8035b9178'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:57.770534 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddba1ca7ae845ecb82b92e8035b9178'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:57.771169 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddba1ca7ae845ecb82b92e8035b9178'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:57.771768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddba1ca7ae845ecb82b92e8035b9178'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:57.783701 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ac743447-da7d-4d5c-970c-e5c6c7a01427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddba1ca7ae845ecb82b92e8035b9178'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:57.795880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1406/2822] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:09:57 2022] DELETE /identity/v3/users/7ddba1ca7ae845ecb82b92e8035b9178 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:57.969569 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:57.971021 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:57.986100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48288d5-63ce-44c7-bc2c-1e1024204652 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.043998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.044671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.044985 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.045263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] PATH_INFO: `/v3/projects/5011fce17cce4813b372c6d7982f4dd5` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.046411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5011fce17cce4813b372c6d7982f4dd5)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.048346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.094997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5011fce17cce4813b372c6d7982f4dd5', 'request_id': 'req-964d1472-a582-40ed-983e-e2b7854d4d33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:58.102864 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5011fce17cce4813b372c6d7982f4dd5', 'request_id': 'req-964d1472-a582-40ed-983e-e2b7854d4d33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:58.108413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5011fce17cce4813b372c6d7982f4dd5', 'request_id': 'req-964d1472-a582-40ed-983e-e2b7854d4d33'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:58.120020 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] The token cache is being invalidate because project 5011fce17cce4813b372c6d7982f4dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:09:58.120311 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:58.121106 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-964d1472-a582-40ed-983e-e2b7854d4d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:58.122578 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1417/2823] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:09:57 2022] DELETE /identity/v3/projects/5011fce17cce4813b372c6d7982f4dd5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:58.127438 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.127760 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.128018 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.150902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:58.152130 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:58.212834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1407/2824] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:58.220869 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.221091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.221395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.240980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:58.242334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:58.250142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1418/2825] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:58.254471 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.265509 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211460d-d047-420d-b6a2-e52356498e40 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.270108 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.270712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.270992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.271266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.271919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:09:58.272222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.274815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.288196 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1408/2826] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:09:58.292721 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.301833 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90f08e-90d5-424f-964c-bac0818b71ab None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.306868 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.307454 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.307729 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.307995 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.308653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.310530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.339818 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1419/2827] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:58.344039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.354263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b4123-d52f-4659-a264-3c5fc9205679 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.357784 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:58.416102 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.416747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.417017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.417279 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.417904 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.420332 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.446608 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1409/2828] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:58.450700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.461178 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fffc-a6e4-4467-84b2-9e0a422e4ea0 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.465802 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.466394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.466674 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.466947 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.467589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.469206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.479337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1420/2829] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:58.483070 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.493501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fbbd1-2139-4611-83f1-27d6dc0d02bf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.499105 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.499959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.500369 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.500815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.501777 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.504470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36898b-dd36-416f-bb71-6ad006408d92 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.519096 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1410/2830] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:58.523285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.537793 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c49d0-be41-4b49-8dc4-f10d0f52bcd3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.542539 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.543190 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.543464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.543736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] PATH_INFO: `/v3/projects/6e9b41e5df434ed9ba73c64298bc7925/users/83181b498e9c4544ba0397ed18a051fc/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.559203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9b41e5df434ed9ba73c64298bc7925, user_id=83181b498e9c4544ba0397ed18a051fc, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.561920 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.575520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1421/2831] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:09:58 2022] PUT /identity/v3/projects/6e9b41e5df434ed9ba73c64298bc7925/users/83181b498e9c4544ba0397ed18a051fc/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:58.585776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.586176 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.586451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.613069 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] MFA Rules not processed for user `83181b498e9c4544ba0397ed18a051fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:58.614264 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:58.677540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1411/2832] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:58.682861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.712024 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:58.744480 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb21-7724-4ddb-8c1e-39f08fa86c63 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.749025 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.749619 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.749891 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.750158 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.750783 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.752680 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.778652 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1422/2833] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:58.782833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.794039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c818f-e9f1-4472-ac13-af4bae2080c1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.850367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.850367 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.850602 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.850928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.851723 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.853618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.876100 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1412/2834] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:09:58 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:09:58.880208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.891413 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c80e3-5b76-43ca-bbc6-51d39339ffc3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.896087 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.896785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.897126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.897460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.898975 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.900689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.912321 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1423/2835] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:58.916044 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.922301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:58.926235 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c213a-05a9-4aa9-aa36-1ce19e65b758 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:58.933127 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:58.933857 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:58.934203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:58.934540 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] PATH_INFO: `/v3/projects/d75e3414549247a78e158bcad478a668/users/e972c676f77f438eb3a7ae0e81086716/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:58.949848 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75e3414549247a78e158bcad478a668, user_id=e972c676f77f438eb3a7ae0e81086716, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:58.952499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:58.966994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1413/2836] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:09:58 2022] PUT /identity/v3/projects/d75e3414549247a78e158bcad478a668/users/e972c676f77f438eb3a7ae0e81086716/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:58.970941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:58.981261 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a5ae0-5dd1-47c1-bdca-b4031d98f79b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.040206 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.040849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.041127 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.041393 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.042052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.043621 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e0fd7-59cc-4a2e-aae7-44cd8526f23e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:59.053082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1424/2837] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:09:59.058179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:59.068253 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6b12-a09b-41b0-b75b-24c3b837b3ea admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.072788 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.073427 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.073698 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.073959 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] PATH_INFO: `/v3/projects/d75e3414549247a78e158bcad478a668/users/e972c676f77f438eb3a7ae0e81086716/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.075868 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75e3414549247a78e158bcad478a668, user_id=e972c676f77f438eb3a7ae0e81086716, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.078532 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:59.088922 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1414/2838] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:09:59 2022] PUT /identity/v3/projects/d75e3414549247a78e158bcad478a668/users/e972c676f77f438eb3a7ae0e81086716/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:59.100347 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.100664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.100941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.128801 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] MFA Rules not processed for user `e972c676f77f438eb3a7ae0e81086716`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:59.130002 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:59.197673 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1425/2839] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:59.208932 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:59.211498 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:59.268420 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c55cf-2b9c-4b3d-90f0-3e3be1bf8371 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.271994 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.272599 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.272882 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.273758 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.282910 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.284330 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507ed7-0f56-470f-ab8d-fd43375b8338 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:59.294385 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1415/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:09:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:59.358846 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:59.383792 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:09:59.420851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d5f5b-6599-486c-9a43-bbaaa6e9c13c None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.425297 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.425915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.426188 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.426462 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] PATH_INFO: `/v3/users/83181b498e9c4544ba0397ed18a051fc` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.427567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83181b498e9c4544ba0397ed18a051fc)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.430264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:59.474575 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83181b498e9c4544ba0397ed18a051fc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:59.481649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83181b498e9c4544ba0397ed18a051fc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:59.482305 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83181b498e9c4544ba0397ed18a051fc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:59.482890 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83181b498e9c4544ba0397ed18a051fc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:59.489618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83181b498e9c4544ba0397ed18a051fc'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:09:59.507232 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1426/2841] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:09:59 2022] DELETE /identity/v3/users/83181b498e9c4544ba0397ed18a051fc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:09:59.513010 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.513291 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.513559 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.531931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:09:59.533066 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:59.592266 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1416/2842] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:09:59.602502 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:59.603880 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:59.660100 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc903a-582c-4e83-b0b1-9baa2dc3d01b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.663835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.664605 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.664888 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.665152 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.673986 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.675386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:09:59.684967 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1427/2843] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:09:59.947919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:09:59.949398 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:09:59.963934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e45c9-5bdc-456e-a6bc-19e014227842 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:09:59.968753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:09:59.969436 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:09:59.969662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:09:59.969934 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] PATH_INFO: `/v3/projects/6e9b41e5df434ed9ba73c64298bc7925` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:09:59.971080 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9b41e5df434ed9ba73c64298bc7925)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:09:59.973034 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.023575 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9b41e5df434ed9ba73c64298bc7925', 'request_id': 'req-2e211162-de18-4443-9686-9040f7ed9b4e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.030150 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9b41e5df434ed9ba73c64298bc7925', 'request_id': 'req-2e211162-de18-4443-9686-9040f7ed9b4e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.037703 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9b41e5df434ed9ba73c64298bc7925', 'request_id': 'req-2e211162-de18-4443-9686-9040f7ed9b4e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.042451 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:00.051886 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] The token cache is being invalidate because project 6e9b41e5df434ed9ba73c64298bc7925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:00.052366 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.053318 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.055270 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1417/2844] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:09:59 2022] DELETE /identity/v3/projects/6e9b41e5df434ed9ba73c64298bc7925 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:00.059275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.068835 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797883a-ee0a-401d-b8f2-8e740892d6ba service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.109566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:00.126341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.126978 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.127257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.127527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] PATH_INFO: `/v3/users/e972c676f77f438eb3a7ae0e81086716` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.128665 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e972c676f77f438eb3a7ae0e81086716)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.130576 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.176637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e972c676f77f438eb3a7ae0e81086716'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.184398 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e972c676f77f438eb3a7ae0e81086716'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.185060 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e972c676f77f438eb3a7ae0e81086716'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.185702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e972c676f77f438eb3a7ae0e81086716'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.192508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-4a175535-3a3e-49e5-8d92-bfeaad0cca79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e972c676f77f438eb3a7ae0e81086716'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.209943 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1428/2845] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:00 2022] DELETE /identity/v3/users/e972c676f77f438eb3a7ae0e81086716 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:00.475759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.477744 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:00.496147 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e211162-de18-4443-9686-9040f7ed9b4e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.554930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.555554 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.555832 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.556120 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] PATH_INFO: `/v3/projects/d75e3414549247a78e158bcad478a668` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.557229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75e3414549247a78e158bcad478a668)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.559229 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.611648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75e3414549247a78e158bcad478a668', 'request_id': 'req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.618450 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75e3414549247a78e158bcad478a668', 'request_id': 'req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.626024 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75e3414549247a78e158bcad478a668', 'request_id': 'req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.636470 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] The token cache is being invalidate because project d75e3414549247a78e158bcad478a668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:00.636773 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.637399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-560bd7d7-ea97-4656-b7ff-d2e4ec8230c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:00.638870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1418/2846] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:00 2022] DELETE /identity/v3/projects/d75e3414549247a78e158bcad478a668 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:00.643722 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.644005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.644276 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.666120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:00.667320 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:00.724420 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1429/2847] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:00.732756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.733040 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.733342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.752654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:00.753845 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:00.761771 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1419/2848] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:00.766040 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.776141 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81462b2a-d363-42c3-826d-8f81510cf1fc None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.780698 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.781288 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.781565 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.781834 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.782477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:00.782779 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.784352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.796113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1430/2849] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:00.800237 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.809522 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516c5bd-40cb-4bff-8043-dce80272e8c6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.814039 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.814617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.814887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.815149 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.815775 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.817746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.846495 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1420/2850] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:00 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:10:00.850694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.861852 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb58e6-40a6-4caa-82bc-4ea7e5ca8187 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.906541 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:00.917692 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.918312 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.918586 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.918853 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.919477 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.921386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.941915 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1431/2851] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:00 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:10:00.946055 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.956395 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb993c7e-1c5e-452d-94b6-b5a171d6ac60 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.961662 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.962510 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.962794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.963064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.963707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.965342 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:00.975179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1421/2852] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:00.979242 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:00.989046 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cd45e-2eb3-4b7a-bb16-4a2a29190aac admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:00.994307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:00.994889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:00.995185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:00.995438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:00.996071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:00.997671 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac5de-ed11-4b10-af59-6fe9ad0cecda admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.008753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1432/2853] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:01.013207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.024261 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3903b1-760e-4d54-bdae-b088fb2f5de7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.028893 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.029538 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.029812 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.030078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] PATH_INFO: `/v3/projects/a0f63c11159d44bb9d5b2ec434c09b04/users/3a8f51c717c74be3b7c5124582dcdc0f/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.044970 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f63c11159d44bb9d5b2ec434c09b04, user_id=3a8f51c717c74be3b7c5124582dcdc0f, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.047612 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.060907 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1422/2854] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:01 2022] PUT /identity/v3/projects/a0f63c11159d44bb9d5b2ec434c09b04/users/3a8f51c717c74be3b7c5124582dcdc0f/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:01.072424 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.072951 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.073070 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.101907 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] MFA Rules not processed for user `3a8f51c717c74be3b7c5124582dcdc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:01.103102 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:01.164535 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1433/2855] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:01.168864 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.189214 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:01.230553 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a41847-481d-45e6-b953-55d2c9c2afc4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.235171 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.235762 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.236035 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.236301 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.236964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.238833 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.265019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1423/2856] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:01 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:10:01.269250 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.280274 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e784b-081c-4e7e-9218-8349961b3358 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.334403 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.334987 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.335264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.336119 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.336768 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.338669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.359205 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1434/2857] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:01 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:01.363340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.373544 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945feecc-29bf-405e-94e4-40758b6ebf4e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.378052 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.378640 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.378914 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.379180 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.379807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.381435 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.392231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1424/2858] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:01.396307 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.406997 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002db22-4db3-43fd-8bc6-aa3d656e3031 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.412382 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.413072 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.413351 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.413669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] PATH_INFO: `/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0/users/88033a5bc60747e4882603b5d419c904/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.428285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982fa8b2ba9244e78aa8472fbc3fc3f0, user_id=88033a5bc60747e4882603b5d419c904, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.431889 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.444520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1435/2859] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:01 2022] PUT /identity/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0/users/88033a5bc60747e4882603b5d419c904/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:01.449326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.459185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838213d6-866e-42fd-99eb-13f6f850168a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.514574 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.515213 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.515441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.515713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.516345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.517955 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4476-69dc-42ce-a53a-00a517f9d740 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.527585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1425/2860] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:01.531711 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.541854 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86119684-a7d9-4f18-be08-891b8bb07af1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.546516 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.547162 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.547441 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.547714 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] PATH_INFO: `/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0/users/88033a5bc60747e4882603b5d419c904/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.549644 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982fa8b2ba9244e78aa8472fbc3fc3f0, user_id=88033a5bc60747e4882603b5d419c904, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.552262 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.563290 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1436/2861] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:01 2022] PUT /identity/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0/users/88033a5bc60747e4882603b5d419c904/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:01.574219 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.574507 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.574783 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.602216 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] MFA Rules not processed for user `88033a5bc60747e4882603b5d419c904`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:01.603422 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:01.672063 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1426/2862] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:01.685142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:01.686858 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:01.701253 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:01.745468 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bb8a-b04c-4104-b797-adad89276732 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:01.749174 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:01.749771 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:01.750045 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:01.750317 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:01.759116 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:01.760519 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:01.769712 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1437/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:02.081614 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.090880 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26796dac-3ef3-480c-afd5-705ba6feb252 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.095615 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88033a5bc60747e4882603b5d419c904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.096247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.096567 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.096873 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.097542 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:02.097870 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.099462 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.111700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1427/2864] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:02.115882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.125080 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb7488-a58d-4d3f-8a44-95af1d813668 service cinder] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.129631 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88033a5bc60747e4882603b5d419c904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.130220 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.130501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.130775 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.131409 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.133329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.160973 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1438/2865] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:02 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:02.165623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.170768 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:02.177502 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16619a0-eb0a-4ee3-a30f-35521d0f7ca9 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.232836 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88033a5bc60747e4882603b5d419c904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.233433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.233713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.233987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.234629 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:02.234931 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.236520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.249677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1428/2866] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:02.285928 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.296010 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9470-6479-40f0-afeb-49ebe1da22c6 tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.300558 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88033a5bc60747e4882603b5d419c904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.301204 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.301487 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.301761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] PATH_INFO: `/v3/projects/690355e6a1ef452699a2a89ac2f61afb` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.302879 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorizing `identity:delete_project(project_id=690355e6a1ef452699a2a89ac2f61afb)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.305062 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.350742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690355e6a1ef452699a2a89ac2f61afb', 'request_id': 'req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.357515 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690355e6a1ef452699a2a89ac2f61afb', 'request_id': 'req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.362968 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690355e6a1ef452699a2a89ac2f61afb', 'request_id': 'req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.374774 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] The token cache is being invalidate because project 690355e6a1ef452699a2a89ac2f61afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:02.375065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.375736 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-c232e4a7-f4e8-41fe-9ebb-ee36b5c35aad tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.377263 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1439/2867] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:02 2022] DELETE /identity/v3/projects/690355e6a1ef452699a2a89ac2f61afb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:02.578954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.580725 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:02.644695 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3aeb4-1b4f-447f-961f-27ae3317c9ab tempest-VolumeQuotaClassesTest-1733951106 tempest-VolumeQuotaClassesTest-1733951106-project-admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.700356 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.701017 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.701297 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.701568 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] PATH_INFO: `/v3/users/3a8f51c717c74be3b7c5124582dcdc0f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.702720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8f51c717c74be3b7c5124582dcdc0f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.704675 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.749566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:02.751170 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8f51c717c74be3b7c5124582dcdc0f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.759439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8f51c717c74be3b7c5124582dcdc0f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.760061 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8f51c717c74be3b7c5124582dcdc0f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.760699 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8f51c717c74be3b7c5124582dcdc0f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.772439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8f51c717c74be3b7c5124582dcdc0f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:02.785227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1429/2868] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:02 2022] DELETE /identity/v3/users/3a8f51c717c74be3b7c5124582dcdc0f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:02.789701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.790181 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.790464 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.809126 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:02.810344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:02.870175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1440/2869] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:02.879781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:02.881185 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:02.937124 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd0c0b-64a7-42cd-85a7-90ed1b16facf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:02.940708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:02.941296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:02.941565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:02.941830 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:02.951628 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:02.953375 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:02.962619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1430/2870] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:03.225861 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:03.228081 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:03.241613 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2b7e1-6862-4843-af13-68a6fa5172b4 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:03.246876 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:03.247716 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:03.247999 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:03.248326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] PATH_INFO: `/v3/projects/a0f63c11159d44bb9d5b2ec434c09b04` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:03.249488 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f63c11159d44bb9d5b2ec434c09b04)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:03.251504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:03.262816 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:03.299435 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f63c11159d44bb9d5b2ec434c09b04', 'request_id': 'req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.306756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f63c11159d44bb9d5b2ec434c09b04', 'request_id': 'req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.312702 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f63c11159d44bb9d5b2ec434c09b04', 'request_id': 'req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.324213 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] The token cache is being invalidate because project a0f63c11159d44bb9d5b2ec434c09b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:03.324494 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.325159 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.326610 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1441/2871] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:03 2022] DELETE /identity/v3/projects/a0f63c11159d44bb9d5b2ec434c09b04 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:03.330561 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:03.340713 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc112ed-60de-4dc7-b55a-34722294ee63 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:03.396589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:03.397227 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:03.397506 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:03.397780 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] PATH_INFO: `/v3/users/88033a5bc60747e4882603b5d419c904` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:03.398966 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=88033a5bc60747e4882603b5d419c904)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:03.401769 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:03.448217 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88033a5bc60747e4882603b5d419c904'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.456188 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88033a5bc60747e4882603b5d419c904'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.456960 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88033a5bc60747e4882603b5d419c904'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.457566 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88033a5bc60747e4882603b5d419c904'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.468442 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:03.470854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8fd4a871-c110-4a42-bc33-5515139ff3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88033a5bc60747e4882603b5d419c904'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.484897 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1431/2872] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:03 2022] DELETE /identity/v3/users/88033a5bc60747e4882603b5d419c904 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:03.750927 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:03.752528 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:03.767032 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee694b-c1c6-4e01-8ca5-da54bb80a5ab admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:03.824405 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:03.825071 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:03.825335 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:03.825606 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] PATH_INFO: `/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:03.826701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=982fa8b2ba9244e78aa8472fbc3fc3f0)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:03.828661 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:03.875851 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'request_id': 'req-951990e7-bbe1-408b-abe5-122250cd1d7e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.882682 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'request_id': 'req-951990e7-bbe1-408b-abe5-122250cd1d7e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.889364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982fa8b2ba9244e78aa8472fbc3fc3f0', 'request_id': 'req-951990e7-bbe1-408b-abe5-122250cd1d7e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.900545 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] The token cache is being invalidate because project 982fa8b2ba9244e78aa8472fbc3fc3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81411) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:03.900865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.901510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-951990e7-bbe1-408b-abe5-122250cd1d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:03.902976 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1442/2873] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:03 2022] DELETE /identity/v3/projects/982fa8b2ba9244e78aa8472fbc3fc3f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:03.907944 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:03.908233 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:03.908508 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:03.928399 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:03.929865 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:03.990942 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1432/2874] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:04.000148 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.000428 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.000723 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.021660 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:04.022914 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:04.031341 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1443/2875] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:04.035764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.046589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f78a9-6479-4018-9adb-1211f0a6af82 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.051207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.051807 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.052083 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.052349 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.053019 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:04.053320 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.055160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.067218 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1433/2876] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:04.072173 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.081310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dea1f-8ed1-403c-8f6e-4a0eafb52412 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.085756 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.087365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.087784 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.088064 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.088725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.090601 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.112214 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:04.119510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1444/2877] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:04.123472 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.133986 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2d81b-7287-4fc1-8e6d-0d621808980b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.189806 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.190404 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.190682 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.190953 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.191583 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.193523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.215663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1434/2878] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:04.219637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.229632 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb59def-65eb-478a-a815-6ccb4c5d744b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.234145 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.234725 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.234998 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.235264 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.235893 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.237501 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.246990 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1445/2879] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:04.250737 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.261329 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8a7a5-d2d2-45fe-b65c-94d4773a909b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.266008 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.266595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.266874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.267143 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.267776 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.269400 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130806c-68c8-437a-9e3d-8d0e8148869c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.280501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1435/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:04.284429 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.294038 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c9142-e6c3-4bed-a23e-fb28b4b84fe3 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.298482 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.299108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.299383 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.299651 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] PATH_INFO: `/v3/projects/640e2f2a86fa47d9825a298c4f46035b/users/0d80048723564860a121149131c0a0a3/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.314208 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640e2f2a86fa47d9825a298c4f46035b, user_id=0d80048723564860a121149131c0a0a3, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.316839 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.329769 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1446/2881] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:04 2022] PUT /identity/v3/projects/640e2f2a86fa47d9825a298c4f46035b/users/0d80048723564860a121149131c0a0a3/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:04.393136 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.393657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.393657 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.421623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] MFA Rules not processed for user `0d80048723564860a121149131c0a0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:04.422818 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:04.467439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:04.491661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1436/2882] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:04.496693 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.556271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28952f0-c66c-4c52-8c6a-64394f8dac62 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.561581 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.563029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.563029 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.563235 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.563964 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.565892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.592916 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1447/2883] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 07:10:04.596912 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.607520 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d563a57-527f-4a8b-9396-86f09e0739d3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.662973 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.663491 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.663764 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.664027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.664727 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.666814 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.691586 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1437/2884] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:04.693056 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.703195 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2516-7173-486c-90d6-2e519d241977 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.707845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.708432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.708753 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.709027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.709664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.711310 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.722887 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1448/2885] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:04.726909 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.737123 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bccd2-746e-4055-a91d-179f8e9e7fb0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.741664 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.742307 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.742587 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.743433 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] PATH_INFO: `/v3/projects/447ba5a413c647998200b0c738a4bfeb/users/0488139516a9497897a0be5734835e0a/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.758203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447ba5a413c647998200b0c738a4bfeb, user_id=0488139516a9497897a0be5734835e0a, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.761676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.774724 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1438/2886] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:04 2022] PUT /identity/v3/projects/447ba5a413c647998200b0c738a4bfeb/users/0488139516a9497897a0be5734835e0a/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:04.778764 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.788419 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a84e-d415-492b-a271-6f01a1149c34 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.844805 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.845407 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.845683 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.845955 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.846594 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.848251 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39f7e0-1ace-4358-8ee8-e82fc82bdf59 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.859664 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1449/2887] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:04.863749 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:04.875058 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2ca3f-42cd-468a-8bba-9b5ff9600515 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:04.879625 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:04.880269 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.880546 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.880849 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] PATH_INFO: `/v3/projects/447ba5a413c647998200b0c738a4bfeb/users/0488139516a9497897a0be5734835e0a/roles/9178ca05cc9a4676818f53f8a2f1309f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.882732 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=447ba5a413c647998200b0c738a4bfeb, user_id=0488139516a9497897a0be5734835e0a, role_id=9178ca05cc9a4676818f53f8a2f1309f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:04.885927 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:04.895976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1439/2888] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:04 2022] PUT /identity/v3/projects/447ba5a413c647998200b0c738a4bfeb/users/0488139516a9497897a0be5734835e0a/roles/9178ca05cc9a4676818f53f8a2f1309f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:04.905949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:04.906239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:04.906518 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:04.936048 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] MFA Rules not processed for user `0488139516a9497897a0be5734835e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:04.937207 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:04.960645 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:05.005241 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1450/2889] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:05.016152 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:05.017961 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:05.075439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55068ac-4590-4998-97a8-d148c24ebb7e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:05.079104 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:05.079697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:05.079976 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:05.080242 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:05.089189 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:05.090618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f90a2-0be7-4a01-976e-6377ad913627 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:05.099822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1440/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:05.469747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:05.531566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9d33-177b-44e6-94fc-c4f914abe8b5 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:05.536052 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:05.536701 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:05.536972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:05.537234 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] PATH_INFO: `/v3/users/0d80048723564860a121149131c0a0a3` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:05.538330 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d80048723564860a121149131c0a0a3)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:05.540223 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:05.585608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d80048723564860a121149131c0a0a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:05.594209 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d80048723564860a121149131c0a0a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:05.594884 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d80048723564860a121149131c0a0a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:05.595479 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d80048723564860a121149131c0a0a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:05.602271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d80048723564860a121149131c0a0a3'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:05.619608 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1451/2891] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:05 2022] DELETE /identity/v3/users/0d80048723564860a121149131c0a0a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:05.624142 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:05.624666 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:05.624840 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:05.643766 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:05.644995 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:05.674159 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:05.704289 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1441/2892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:05.714142 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:05.715527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:05.758798 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:05.772855 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19987-afe3-4b30-820f-3dc351e99527 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:05.776495 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:05.777113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:05.777387 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:05.777657 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:05.786326 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:05.787730 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:05.797400 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1452/2893] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:06.064683 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:06.066090 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:06.078549 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c239b15-f2f4-4bba-bb8e-66a0db0972e8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:06.083151 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:06.083787 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.084064 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.084337 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] PATH_INFO: `/v3/projects/640e2f2a86fa47d9825a298c4f46035b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.085474 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] RBAC: Authorizing `identity:delete_project(project_id=640e2f2a86fa47d9825a298c4f46035b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:06.087903 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:06.134203 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640e2f2a86fa47d9825a298c4f46035b', 'request_id': 'req-dc135ae4-a16d-4760-9431-4b971796285c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.140365 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640e2f2a86fa47d9825a298c4f46035b', 'request_id': 'req-dc135ae4-a16d-4760-9431-4b971796285c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.147352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640e2f2a86fa47d9825a298c4f46035b', 'request_id': 'req-dc135ae4-a16d-4760-9431-4b971796285c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.158809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] The token cache is being invalidate because project 640e2f2a86fa47d9825a298c4f46035b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:06.159098 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.159712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.161199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1442/2894] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:06 2022] DELETE /identity/v3/projects/640e2f2a86fa47d9825a298c4f46035b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:06.165953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:06.175239 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225a45e-56d7-48a2-ab95-94c838a86ac2 service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:06.230592 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:06.231153 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.231432 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.231708 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] PATH_INFO: `/v3/users/0488139516a9497897a0be5734835e0a` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.232848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0488139516a9497897a0be5734835e0a)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:06.234750 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:06.280041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0488139516a9497897a0be5734835e0a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.287176 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0488139516a9497897a0be5734835e0a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.287788 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0488139516a9497897a0be5734835e0a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.288411 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0488139516a9497897a0be5734835e0a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.295959 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-1be2a806-e942-4205-abfc-f51b93f08d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0488139516a9497897a0be5734835e0a'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.314211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1453/2895] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:06 2022] DELETE /identity/v3/users/0488139516a9497897a0be5734835e0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:06.585523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:06.587077 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:06.600677 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135ae4-a16d-4760-9431-4b971796285c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:06.660992 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:06.661704 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.661892 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.662167 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] PATH_INFO: `/v3/projects/447ba5a413c647998200b0c738a4bfeb` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.663296 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447ba5a413c647998200b0c738a4bfeb)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:06.665928 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:06.725327 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447ba5a413c647998200b0c738a4bfeb', 'request_id': 'req-eb40a81f-1f88-4f91-84ff-634871e65371'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.732499 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447ba5a413c647998200b0c738a4bfeb', 'request_id': 'req-eb40a81f-1f88-4f91-84ff-634871e65371'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.741426 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447ba5a413c647998200b0c738a4bfeb', 'request_id': 'req-eb40a81f-1f88-4f91-84ff-634871e65371'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.743256 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:06.761418 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] The token cache is being invalidate because project 447ba5a413c647998200b0c738a4bfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:06.761621 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.762247 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb40a81f-1f88-4f91-84ff-634871e65371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:06.763712 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1443/2896] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:06 2022] DELETE /identity/v3/projects/447ba5a413c647998200b0c738a4bfeb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:06.769355 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.769848 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.770101 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.791653 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:06.792923 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:06.862327 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1454/2897] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:06.871252 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.871899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.871899 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.893414 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:06.894716 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:06.904634 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1444/2898] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:10:06.909005 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:06.913780 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:06.921406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fcbc4-02ea-4e5a-b0bc-c8cad1fea6ed None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:06.927364 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:06.927994 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.928386 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.928685 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.929589 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:06.929882 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:06.931700 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:06.945694 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1455/2899] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:06.950335 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:06.959876 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6a470-c20b-4602-bd6d-ed23f93e7565 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:06.965820 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:06.967477 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:06.967754 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:06.968027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:06.968707 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:06.970617 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.000977 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1445/2900] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:06 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:07.005370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.016836 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18981db6-7506-4d39-82cb-f16951636d3b admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.083737 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.084345 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.084649 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.084926 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.085559 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.088091 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.111365 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1456/2901] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:07 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:07.115654 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.128947 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bf28-2738-4bb4-bdcb-9032c912201d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.136299 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.137254 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.137715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.138160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.139209 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.140834 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.152823 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1446/2902] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:07.157500 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.168211 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee421-b88e-4c0e-b1f2-39829f7a576f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.174527 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.175133 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.175415 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.175689 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.176337 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.178073 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde33445-df1c-4b1a-869e-2f181eeac5bb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.189471 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1457/2903] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:07.193894 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.207341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69997912-d38c-4a07-a49e-5d5176b1018a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.213619 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.214345 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.214658 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.215046 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] PATH_INFO: `/v3/projects/c5303f77e57341e2b8e7d67b562e0680/users/c72491bed98e41f789c3a01011723f60/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.233322 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5303f77e57341e2b8e7d67b562e0680, user_id=c72491bed98e41f789c3a01011723f60, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.235964 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.250310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1447/2904] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:07 2022] PUT /identity/v3/projects/c5303f77e57341e2b8e7d67b562e0680/users/c72491bed98e41f789c3a01011723f60/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:07.262460 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.262747 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.263019 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.294134 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] MFA Rules not processed for user `c72491bed98e41f789c3a01011723f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:07.295285 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:07.368983 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1458/2905] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:07.385449 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.387822 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:07.447125 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97632238-40c5-44fd-8538-5aabc6489fdb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.450913 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.451516 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.451798 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.452074 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.460680 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.462207 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e1ee2-e063-4fbf-9b68-52382d425e09 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.471222 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1448/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:07.493548 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.552344 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:07.557266 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732755bc-b558-4bbf-ab8e-1fb1ea3bd385 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.562912 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.563530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.563811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.564089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] PATH_INFO: `/v3/users/c72491bed98e41f789c3a01011723f60` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.565256 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72491bed98e41f789c3a01011723f60)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.567238 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.613510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72491bed98e41f789c3a01011723f60'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:07.621636 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72491bed98e41f789c3a01011723f60'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:07.622340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72491bed98e41f789c3a01011723f60'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:07.622953 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72491bed98e41f789c3a01011723f60'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:07.630011 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72491bed98e41f789c3a01011723f60'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:07.647509 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1459/2907] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:07 2022] DELETE /identity/v3/users/c72491bed98e41f789c3a01011723f60 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:07.652223 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.652547 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.652854 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.671753 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:07.672974 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:07.731042 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1449/2908] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:10:07.740761 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:07.742193 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:07.799622 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcac95-2b30-435e-a9de-721599898f68 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:07.803395 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:07.804192 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:07.804690 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:07.804803 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:07.815113 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:07.816567 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9445-d3fd-4a4c-a589-3db8291833da service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:07.826058 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1460/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:08.093263 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.094801 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:08.107394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e535a6-f763-4fda-836a-a70899f08eeb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.112045 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.112708 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.112983 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.113248 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] PATH_INFO: `/v3/projects/c5303f77e57341e2b8e7d67b562e0680` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.114389 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5303f77e57341e2b8e7d67b562e0680)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.116292 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.141313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:08.167343 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5303f77e57341e2b8e7d67b562e0680', 'request_id': 'req-0ded7926-8641-4741-b10f-a164ba2bb4ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:08.173691 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5303f77e57341e2b8e7d67b562e0680', 'request_id': 'req-0ded7926-8641-4741-b10f-a164ba2bb4ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:08.181987 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5303f77e57341e2b8e7d67b562e0680', 'request_id': 'req-0ded7926-8641-4741-b10f-a164ba2bb4ce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:08.192137 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] The token cache is being invalidate because project c5303f77e57341e2b8e7d67b562e0680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:08.192421 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:08.193065 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0ded7926-8641-4741-b10f-a164ba2bb4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:08.194523 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1450/2910] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:08 2022] DELETE /identity/v3/projects/c5303f77e57341e2b8e7d67b562e0680 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:08.199936 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.200219 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.200491 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.219922 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:08.221196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:08.282892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1461/2911] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:08.295596 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.295887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.296168 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.317131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:08.318331 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:08.327341 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1451/2912] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:08.331530 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.341695 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e18714-43d5-496d-a346-5a70c857b2f2 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.346194 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.346787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.347065 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.347334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.347979 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:08.348281 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.349904 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.361520 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1462/2913] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:08.365590 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.375439 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3125d0-a5de-428c-97b5-e90a6bb2c047 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.379979 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.380565 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.380863 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.381131 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.381759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.384481 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.410681 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1452/2914] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:08.414903 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.424917 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eccd25-8a7a-4473-bdf9-1be7a8439b38 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.428440 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:08.487640 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.488236 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.488510 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.488811 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.489434 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.491332 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.512302 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1463/2915] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:08 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:08.516720 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.531177 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14a6f0-39c5-4f7c-b6d8-e5091c9af6e5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.536930 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.537533 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.537809 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.538078 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.538722 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.540313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.551501 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1453/2916] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:08.555669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.566553 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84559-96d8-4fb5-ba38-a6586450e06f admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.571248 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.571944 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.572845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.573121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.573762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.575352 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12090e7-1baf-4527-bdfe-edeb4040dffc admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.585993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1464/2917] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:08.590201 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.600191 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad8c14-d7cb-4425-8c6a-4e93c4f8e508 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.605344 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.605982 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.606257 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.606529 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] PATH_INFO: `/v3/projects/f62c7e3596c54d51b086f53168f114bf/users/14c9f9fcc9a741ae9205e3936bf93a6e/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.621700 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62c7e3596c54d51b086f53168f114bf, user_id=14c9f9fcc9a741ae9205e3936bf93a6e, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.624315 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.637273 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1454/2918] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:08 2022] PUT /identity/v3/projects/f62c7e3596c54d51b086f53168f114bf/users/14c9f9fcc9a741ae9205e3936bf93a6e/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:08.649049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.649340 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.649618 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.678438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] MFA Rules not processed for user `14c9f9fcc9a741ae9205e3936bf93a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:08.679933 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:08.743098 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1465/2919] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:08.754492 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:08.756231 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:08.813277 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae0832-5973-44dd-81ec-3509f852e31e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:08.816887 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:08.817489 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:08.817767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:08.818038 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:08.826692 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:08.828119 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d463c-ff89-49f9-903c-5f38b5684e8a service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:08.836781 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1455/2920] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:14.156028 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:14.217490 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dba67f-1337-45a8-8bc2-23d5d3fcbd98 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:14.221892 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:14.222504 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.222777 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.223042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] PATH_INFO: `/v3/users/14c9f9fcc9a741ae9205e3936bf93a6e` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.224143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c9f9fcc9a741ae9205e3936bf93a6e)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:14.226049 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:14.240875 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:14.273785 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c9f9fcc9a741ae9205e3936bf93a6e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.281185 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c9f9fcc9a741ae9205e3936bf93a6e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.281821 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c9f9fcc9a741ae9205e3936bf93a6e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.282511 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c9f9fcc9a741ae9205e3936bf93a6e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.289346 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c9f9fcc9a741ae9205e3936bf93a6e'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.308295 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1466/2921] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:14 2022] DELETE /identity/v3/users/14c9f9fcc9a741ae9205e3936bf93a6e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:14.312856 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.313339 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.313441 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.332715 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:14.333902 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:14.376493 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:14.393623 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1456/2922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:14.403823 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:14.405293 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:14.461334 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669328c-d113-44d7-8ffe-4c4a70471e9d admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:14.465366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:14.465972 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.466245 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.466508 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.481203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:14.482648 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05ea7-b28d-4b48-b253-362b0b798ad2 service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:14.491865 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1467/2923] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:14.760282 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:14.761794 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:14.775954 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32835-7555-437d-adc9-e97b865bfeec None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:14.780530 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:14.781198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.781476 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.781745 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] PATH_INFO: `/v3/projects/f62c7e3596c54d51b086f53168f114bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.782874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62c7e3596c54d51b086f53168f114bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:14.784800 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:14.833313 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62c7e3596c54d51b086f53168f114bf', 'request_id': 'req-c03de6ae-6273-4d27-95b5-21eeb2836d7b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.840705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62c7e3596c54d51b086f53168f114bf', 'request_id': 'req-c03de6ae-6273-4d27-95b5-21eeb2836d7b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.848175 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62c7e3596c54d51b086f53168f114bf', 'request_id': 'req-c03de6ae-6273-4d27-95b5-21eeb2836d7b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.860676 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] The token cache is being invalidate because project f62c7e3596c54d51b086f53168f114bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:14.860963 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.861589 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c03de6ae-6273-4d27-95b5-21eeb2836d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:14.863067 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1457/2924] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:14 2022] DELETE /identity/v3/projects/f62c7e3596c54d51b086f53168f114bf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 07:10:14.868659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.868937 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.869329 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.888108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:14.889406 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:14.948175 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1468/2925] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 07:10:14.956051 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:14.956340 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:14.956721 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:14.977645 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:14.979455 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:14.987394 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1458/2926] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:14.991573 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.001948 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e711-0a8d-4517-a393-971d8204020a None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.006566 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.007094 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.007370 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.007637 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.008275 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81411) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 07:10:15.008590 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.010742 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.022549 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1469/2927] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 07:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 07:10:15.027919 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.037160 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1d58-decc-4728-aff6-0a9ddd195885 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.042373 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.043015 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.043324 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.043595 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.044221 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.046198 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.073121 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1459/2928] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 07:10:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:15.077324 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.087203 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4579b-7b3a-4f8c-b541-fc871ddef5f1 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.108027 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:15.144941 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.145560 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.145828 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.146108 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] PATH_INFO: `/v3/users` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.146744 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.148676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.171394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1470/2929] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 07:10:15 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 07:10:15.175603 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.186286 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110df53-f564-474b-9010-d75b3a10e1b8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.190874 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.191468 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.191747 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.192020 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.192697 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.194326 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.204585 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1460/2930] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:15.208543 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.218980 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756758e3-796e-4906-bc43-a85615da2dcb admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.223572 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.224156 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.224433 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.224754 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.225391 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.226960 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95a07-201a-46a1-bcf5-7149d4a61432 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.238121 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1471/2931] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 07:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 07:10:15.242079 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.251756 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b3599-852f-451c-8e57-c5a52b6ca1ee admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.256548 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.257310 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.257537 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.257810 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] PATH_INFO: `/v3/projects/6765e633dcfe4d2b90fe0cfe58969ced/users/9c2aedc28a544a5aae50534465824651/roles/65a7d60481ab48fbb33706644bf422bf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.272767 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6765e633dcfe4d2b90fe0cfe58969ced, user_id=9c2aedc28a544a5aae50534465824651, role_id=65a7d60481ab48fbb33706644bf422bf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.275393 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.288303 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1461/2932] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 07:10:15 2022] PUT /identity/v3/projects/6765e633dcfe4d2b90fe0cfe58969ced/users/9c2aedc28a544a5aae50534465824651/roles/65a7d60481ab48fbb33706644bf422bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:15.298993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] REQUEST_METHOD: `POST` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.299257 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.299532 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.329082 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.auth.core [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] MFA Rules not processed for user `9c2aedc28a544a5aae50534465824651`. Rule list: `[]` (Enabled: `True`). {{(pid=81411) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:15.330303 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:15.392845 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1472/2933] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:15.404199 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:15.405908 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:15.461705 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bb950-ac11-4622-b686-0cd7e56e070f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:15.466027 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9bfa0fb8ee4875a6a9b24607e6a56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:15.466618 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:15.466890 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:15.467156 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:15.475228 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:15.476663 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bba7f1-cf81-4b18-85d8-6f489fb00fa0 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:15.485416 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1462/2934] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:18.038669 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:18.098659 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc83e5-c7f8-41d4-929d-6d2a7a79b8a9 None None] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:18.103059 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:18.103849 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:18.104128 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:18.104394 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] PATH_INFO: `/v3/users/9c2aedc28a544a5aae50534465824651` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:18.105536 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2aedc28a544a5aae50534465824651)` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:18.107412 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:18.145638 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:18.157196 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2aedc28a544a5aae50534465824651'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.164438 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2aedc28a544a5aae50534465824651'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.165089 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2aedc28a544a5aae50534465824651'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.165676 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2aedc28a544a5aae50534465824651'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.172787 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.notifications [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2aedc28a544a5aae50534465824651'} {{(pid=81411) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.190734 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1473/2935] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 07:10:18 2022] DELETE /identity/v3/users/9c2aedc28a544a5aae50534465824651 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:18.195195 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:18.195661 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:18.195759 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:18.215030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] MFA Rules not processed for user `1083a60a7d7244f7a16714f47f1d6e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 07:10:18.216225 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:18.224134 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:18.277030 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1463/2936] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 07:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 07:10:18.286667 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:18.288067 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:18.348120 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2face6-b327-4db2-a665-8f666d224ec8 admin admin] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:18.351794 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6619aa7d0347403ab596d1bfae72e520', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:18.352397 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:18.352718 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:18.352993 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:18.362271 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:18.363684 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:18.374143 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1474/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:10:18.645352 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:10:18.646815 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:10:18.661746 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27f59-b39e-42bf-bd2b-b432d278b8a6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:10:18.668467 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1083a60a7d7244f7a16714f47f1d6e8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7293e66323e0459699b8f04045409629', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:10:18.669129 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:10:18.669403 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:10:18.669670 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] PATH_INFO: `/v3/projects/6765e633dcfe4d2b90fe0cfe58969ced` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:10:18.670795 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6765e633dcfe4d2b90fe0cfe58969ced)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:10:18.672895 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:10:18.719859 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6765e633dcfe4d2b90fe0cfe58969ced', 'request_id': 'req-0981ed33-076a-471b-ae56-dcad90f0056c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.726179 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6765e633dcfe4d2b90fe0cfe58969ced', 'request_id': 'req-0981ed33-076a-471b-ae56-dcad90f0056c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.733920 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6765e633dcfe4d2b90fe0cfe58969ced', 'request_id': 'req-0981ed33-076a-471b-ae56-dcad90f0056c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.745772 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] The token cache is being invalidate because project 6765e633dcfe4d2b90fe0cfe58969ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 07:10:18.746043 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.746678 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0981ed33-076a-471b-ae56-dcad90f0056c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 07:10:18.748178 dv-cinder-856941-4-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1464/2938] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 07:10:18 2022] DELETE /identity/v3/projects/6765e633dcfe4d2b90fe0cfe58969ced => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 07:10:28.368940 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:10:28.741648 dv-cinder-856941-4-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:14:43.384949 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] Authenticating user token {{(pid=81411) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 07:14:43.386427 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:14:43.453806 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dd61-78fd-44fd-b8f7-b42ef5d3bdfd service neutron] Validating token access rules against request {{(pid=81411) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 07:14:43.512123 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db27bb68c344df38e0f3ad7e0df0b46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ffb4d5bf50a4dc2842f06871b92408d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81411) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 07:14:43.512762 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] REQUEST_METHOD: `GET` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 07:14:43.513041 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] SCRIPT_NAME: `/identity` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 07:14:43.513309 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81411) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 07:14:43.515007 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.fernet_utils [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81411) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 07:14:43.527042 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 07:14:43.528642 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bd435-f31d-421a-a668-c0fa7f4ee43c service placement] RBAC: Authorization granted {{(pid=81411) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 07:14:43.539366 dv-cinder-856941-4-smb devstack@keystone.service[81411]: [pid: 81411|app: 0|req: 1475/2939] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 07:14:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 07:14:53.535061 dv-cinder-856941-4-smb devstack@keystone.service[81411]: DEBUG dbcounter [-] [81411] Writing DB stats keystone:SELECT=58 {{(pid=81411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}